-- Logs begin at Thu 2022-06-30 12:36:33 UTC, end at Thu 2022-06-30 14:05:04 UTC. -- Jun 30 13:04:57.004056 dv-cinder-822821-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 30 13:04:57.014491 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 13:04:57 2022] *** Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: nodename: dv-cinder-822821-3-iscsi Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: machine: x86_64 Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: clock source: unix Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: pcre jit disabled Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: detected number of CPU cores: 4 Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: current working directory: / Jun 30 13:04:57.016495 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: detected binary path: /usr/bin/uwsgi-core Jun 30 13:04:57.017130 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: your processes number limit is 47680 Jun 30 13:04:57.017130 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: your memory page size is 4096 bytes Jun 30 13:04:57.017130 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: detected max file descriptor number: 2048 Jun 30 13:04:57.017130 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: lock engine: pthread robust mutexes Jun 30 13:04:57.017130 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: thunder lock: enabled Jun 30 13:04:57.017130 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 30 13:04:57.017130 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 13:04:57.060916 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: Python main interpreter initialized at 0x55d0b85ae9c0 Jun 30 13:04:57.060916 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: python threads support enabled Jun 30 13:04:57.060916 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: your server socket listen backlog is limited to 100 connections Jun 30 13:04:57.060916 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: your mercy for graceful operations on workers is 90 seconds Jun 30 13:04:57.061242 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 13:04:57.061317 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: *** Operational MODE: preforking *** Jun 30 13:04:57.061618 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: *** uWSGI is running in multiple interpreter mode *** Jun 30 13:04:57.061618 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: spawned uWSGI master process (pid: 80025) Jun 30 13:04:57.061805 dv-cinder-822821-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 30 13:04:57.062613 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: spawned uWSGI worker 1 (pid: 80036, cores: 1) Jun 30 13:04:57.062718 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: spawned uWSGI worker 2 (pid: 80037, cores: 1) Jun 30 13:04:57.063845 dv-cinder-822821-3-iscsi devstack@keystone.service[80025]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 13:05:02.465639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:05:02.465639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: from cryptography.utils import int_from_bytes Jun 30 13:05:02.466353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:05:02.466353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: from cryptography.utils import int_from_bytes Jun 30 13:05:02.466353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:05:02.466353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: from cryptography.utils import int_from_bytes Jun 30 13:05:02.466886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:05:02.466886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: from cryptography.utils import int_from_bytes Jun 30 13:05:02.514851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 13:05:02.515003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 13:05:02.515082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 13:05:02.515161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 13:05:02.515232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] command line args: [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 13:05:02.515347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] command line args: [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 13:05:02.515475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 13:05:02.516149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 13:05:02.516235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ================================================================================ {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 13:05:02.516332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ================================================================================ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 13:05:02.516415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] admin_token = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.516587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] admin_token = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.516673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] config_dir = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.516826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.516908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_dir = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.517007 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] config_source = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.517083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.517183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] debug = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.517271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_source = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.517356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] debug = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.517426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.518674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.518825 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.518950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519470 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] list_limit = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] log_config_append = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_config_append = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.519960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] log_dir = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_dir = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] log_file = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.520933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521354 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.521979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.522785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] publish_errors = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] publish_errors = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.523913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] standard_threads = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] standard_threads = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.524913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] use_journal = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_journal = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] use_json = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_json = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.525988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] use_stderr = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.526099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_stderr = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.526218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] use_syslog = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.526331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_syslog = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.526442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.526553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:05:02.526665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.526775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.526898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.527989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.528922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.529988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.530975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.531086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.531239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.531873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.531987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.532903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.533973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.534992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.535909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.536884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.537982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538215 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.538900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.539910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.540934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.541896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.542933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543488 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.543958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.544994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.545953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.546995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.547984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.548916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.549964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.550894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] auth.external = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.external = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.551907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] auth.password = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] auth.token = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.password = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.token = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.552990 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.553964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] credential.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.554890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.555926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.556968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.557942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.558983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.559900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.560940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.561950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.562990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.563917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.564974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565319 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.565916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.566956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567758 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.567984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.568904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.569993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.570908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.571948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.572977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.573945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.574886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.575943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.576977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.577997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.578630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.578747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.578861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.578973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.579924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.580962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.581901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.582944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583171 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.583980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584284 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] role.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] role.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.584976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.585917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.586959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.587985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.588898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.589018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.589398 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.589534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.589649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.589763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.589876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.590909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.591935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.592943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.593055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.593167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.593287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.593401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.593553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.593668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.593668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.594491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.594619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.594736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.594736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.594949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.595979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.596889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.connection = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.597938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.598947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.599984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.600904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 13:05:02.601862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:05:02.601862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 13:05:02.629873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.630047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.630273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.630408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.630644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.630879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.638645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.639288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.667479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.667708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.668003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.668240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.809690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.809886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.859536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.859655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.859768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.859870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.924429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.924580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.924666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.924773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.924873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.924999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.925084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.925218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.925300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.925433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.925550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.925677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.950567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.950796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.951018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.951239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.951454 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.951664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.951878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.955620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.955854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.956082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.956308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.956526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.956738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.956949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.963675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.964811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.976592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.976827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.976973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.977963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.978090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.978300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 13:05:02.995235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.995447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 13:05:02.995756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.995839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.995967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 13:05:02.996063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 13:05:02.996233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.996313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.996480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 13:05:02.996561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.996739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.996821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.996993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.997073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.997248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:02.997524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.008261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.008540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.008719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.008801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.008995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.009091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.009265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.009572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.017927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.018401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.021185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.021492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.021673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.021756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.021951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.022034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.022233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.022317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.022512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.022595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.022790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.022881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.023934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.024117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.024384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.050176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.050676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.051782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.052060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.052278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.052554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.057269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.057578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.057767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.057973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.058054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.058416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.065756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.066038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.066176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.066455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.070509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.070798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.070882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.071080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.071162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.071361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.071445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.071636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.071718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.071911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.071994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.072183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.072266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.072449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.072529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.072713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.091753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.091895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.092029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.092172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.096613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.096789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.100279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.100463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.100573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.100753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.105714 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.105863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.109293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.109450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.112954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.113078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.113249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.113374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.113553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.113689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.113838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.113976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.114134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.114265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.114413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.114535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.133839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.133934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.134121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.134203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.134388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.134483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.134652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.134734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.143088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.143237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.144790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.144937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.145081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.145219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.148290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.148572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.148667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.148850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.148931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.149128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.149208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.149404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.149516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.149706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.162695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.162886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.162987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.163163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.163253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.163440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.163530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.163719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.163802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.164008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.165300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.165537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.165634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.165843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.183417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.183623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.186660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.186874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.190539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.190698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.192267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.192424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.193927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.194069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.194209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.194344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.194493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.194623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.201885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.202005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.204058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.204197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.207315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.207419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.207608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.207691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.208000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.208081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.208280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.208362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.217632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.217725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.217914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.217996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.218192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.218276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.226097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.226194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 13:05:03.226377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.226474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.226652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.226734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.226923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.227005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.227191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.227282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.227559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.227641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.227841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.227923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.228111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.228195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.228392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.228482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.228660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.228743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.228939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.229019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.229198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.229287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.229483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.229567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.229743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.229825 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 13:05:03.268054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0b85ae9c0 pid: 80037 (default app) Jun 30 13:05:03.268153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0b85ae9c0 pid: 80036 (default app) Jun 30 13:05:03.271418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f541-ad1f-4e9a-a892-2f21f6011c4f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:03.271714 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f541-ad1f-4e9a-a892-2f21f6011c4f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:03.271996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f541-ad1f-4e9a-a892-2f21f6011c4f None None] PATH_INFO: `/v3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:03.276161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Thu Jun 30 13:05:03 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:10.842313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb98a-57e8-47cb-843e-1cb6756c5ffa None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:10.842868 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb98a-57e8-47cb-843e-1cb6756c5ffa None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:10.842868 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb98a-57e8-47cb-843e-1cb6756c5ffa None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:10.847142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:10.852309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:10.852685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:10.852877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:10.922742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: INFO dbcounter [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] Registered counter for database keystone Jun 30 13:05:10.944065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG oslo_db.sqlalchemy.engines [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:05:10.950301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writer thread running {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:05:11.127290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG passlib.handlers.bcrypt [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80037) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 13:05:11.127622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG passlib.handlers.bcrypt [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80037) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 13:05:11.181716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:11.183336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:11.303601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 13:05:11.500851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb98a-57e8-47cb-843e-1cb6756c5ffa None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:11.570747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: INFO dbcounter [None req-fa3bb98a-57e8-47cb-843e-1cb6756c5ffa None None] Registered counter for database keystone Jun 30 13:05:11.590143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3bb98a-57e8-47cb-843e-1cb6756c5ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:05:11.596898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writer thread running {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:05:11.713899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb98a-57e8-47cb-843e-1cb6756c5ffa None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:11.718366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6025f-bda9-4797-84a0-81c820f79781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:11.719568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6025f-bda9-4797-84a0-81c820f79781 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:11.719850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6025f-bda9-4797-84a0-81c820f79781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:11.720123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6025f-bda9-4797-84a0-81c820f79781 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:11.728074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6025f-bda9-4797-84a0-81c820f79781 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:11.779543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING keystone.common.rbac_enforcer.enforcer [None req-71b6025f-bda9-4797-84a0-81c820f79781 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 13:05:11.779830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6025f-bda9-4797-84a0-81c820f79781 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:11.789726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Thu Jun 30 13:05:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:05:11.795644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:11.809975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eff100-a0e1-4c20-a51a-24fcc9181868 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:11.814353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cd6bb-11f9-48be-93fd-0325c73a2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:11.815458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cd6bb-11f9-48be-93fd-0325c73a2b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:11.815746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cd6bb-11f9-48be-93fd-0325c73a2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:11.816022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cd6bb-11f9-48be-93fd-0325c73a2b1f admin admin] PATH_INFO: `/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:11.820089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cd6bb-11f9-48be-93fd-0325c73a2b1f admin admin] RBAC: Authorizing `identity:get_project(project_id=7ffb94c3eb4e4540b84c4cb9fb570f96)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:11.871745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b21cd6bb-11f9-48be-93fd-0325c73a2b1f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 13:05:11.872290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cd6bb-11f9-48be-93fd-0325c73a2b1f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:11.877102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Thu Jun 30 13:05:11 2022] GET /identity/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:13.869646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1813755-2b65-441d-a81b-a3e7f53d2754 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:13.870168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1813755-2b65-441d-a81b-a3e7f53d2754 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:13.870271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1813755-2b65-441d-a81b-a3e7f53d2754 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:13.874314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:13.879662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb71b-1cb9-4888-9815-dce89d7279ed None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:13.880058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb71b-1cb9-4888-9815-dce89d7279ed None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:13.880225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb71b-1cb9-4888-9815-dce89d7279ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:13.899171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-78ccb71b-1cb9-4888-9815-dce89d7279ed None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:13.900697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-78ccb71b-1cb9-4888-9815-dce89d7279ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:13.909128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 13:05:13.931146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1813755-2b65-441d-a81b-a3e7f53d2754 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:13.943122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1813755-2b65-441d-a81b-a3e7f53d2754 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:13.947323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153115-2e89-4006-a529-2d2b997cd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:13.947947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153115-2e89-4006-a529-2d2b997cd114 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:13.948231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153115-2e89-4006-a529-2d2b997cd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:13.948511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153115-2e89-4006-a529-2d2b997cd114 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:13.956720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153115-2e89-4006-a529-2d2b997cd114 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:13.958547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153115-2e89-4006-a529-2d2b997cd114 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:13.967501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Thu Jun 30 13:05:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:05:13.973100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb71b-1cb9-4888-9815-dce89d7279ed None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:13.981925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb71b-1cb9-4888-9815-dce89d7279ed None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:13.986271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814caaf0-aec7-4d6d-b4ab-a9502dfbbc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:13.987119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814caaf0-aec7-4d6d-b4ab-a9502dfbbc15 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:13.987405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814caaf0-aec7-4d6d-b4ab-a9502dfbbc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:13.987681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814caaf0-aec7-4d6d-b4ab-a9502dfbbc15 admin admin] PATH_INFO: `/v3/users/baef3d38cf16460a9e38da424a63acd8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:13.989059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814caaf0-aec7-4d6d-b4ab-a9502dfbbc15 admin admin] RBAC: Authorizing `identity:get_user(user_id=baef3d38cf16460a9e38da424a63acd8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:13.990922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814caaf0-aec7-4d6d-b4ab-a9502dfbbc15 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:13.992461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Thu Jun 30 13:05:13 2022] GET /identity/v3/users/baef3d38cf16460a9e38da424a63acd8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:16.064417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c82f-58b2-4f32-bb5a-9502ff13fa76 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.064957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c82f-58b2-4f32-bb5a-9502ff13fa76 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.064957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c82f-58b2-4f32-bb5a-9502ff13fa76 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.066347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:16.071310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e582-72f4-4c57-b2a5-60901a899922 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.071734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e582-72f4-4c57-b2a5-60901a899922 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.071881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e582-72f4-4c57-b2a5-60901a899922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.089196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a069e582-72f4-4c57-b2a5-60901a899922 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:16.089441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fac8ef-fe70-4353-aa4b-ffdd5af9175d None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.089761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fac8ef-fe70-4353-aa4b-ffdd5af9175d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.090045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fac8ef-fe70-4353-aa4b-ffdd5af9175d None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.090411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a069e582-72f4-4c57-b2a5-60901a899922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:16.091374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:16.097168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.097579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.097899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.136774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG passlib.handlers.bcrypt [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80036) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 13:05:16.137198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG passlib.handlers.bcrypt [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80036) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 13:05:16.171952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:16.183675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:16.185287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:16.194814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e582-72f4-4c57-b2a5-60901a899922 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.218292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:16.284958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:16.298788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e582-72f4-4c57-b2a5-60901a899922 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.306703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.332325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.333055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.333346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.333660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.347295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:16.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:16.359546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:16.360393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:16.365620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.406321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908a7f-f18f-4be0-8432-b9ec790bc6f6 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.408597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:16.443896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.444790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.445080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.445361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.447653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:16.467406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633f6a-7c36-412f-a5ca-b1c586f77271 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.500664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.501329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.501644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.501923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.502682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:16.502990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:16.504390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:16.512722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:16.514285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:16.516673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:16.522240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.610821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:05:16.616224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.619339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:16.619450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c05d0e-1207-491e-9b62-bce2b78d74c0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.653701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.654569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.654849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.655121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] PATH_INFO: `/v3/users/baef3d38cf16460a9e38da424a63acd8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.656315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] RBAC: Authorizing `identity:get_user(user_id=baef3d38cf16460a9e38da424a63acd8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:16.657796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:16.659539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/users/baef3d38cf16460a9e38da424a63acd8 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:16.664724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.678377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:16.713784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b8279-05a2-4e21-9103-06fe65b73ed3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.747074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.747850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.748127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.748395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.762525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf6641-93a2-4a49-8445-254f25da262e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.767544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:16.769012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:05:16.791294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:16.792210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:16.793017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:05:16.793017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:05:16.793017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:05:16.793017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:16.793017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:16.798619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.798781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.799578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.799867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.800150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.801331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:16.802820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:16.804410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:16.810001 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:16.856923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:16.889700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:16.901121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138a3c1-5e59-4b7f-88ba-ae6ca1e29d9b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.909689 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efb068-d08d-4e96-b5ed-b44211312551 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:16.933634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e4424-5933-4aa9-9515-cbd76b58c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.934291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e4424-5933-4aa9-9515-cbd76b58c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.934577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e4424-5933-4aa9-9515-cbd76b58c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.934863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e4424-5933-4aa9-9515-cbd76b58c1d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.935586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e4424-5933-4aa9-9515-cbd76b58c1d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:16.935891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e4424-5933-4aa9-9515-cbd76b58c1d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:16.937892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e4424-5933-4aa9-9515-cbd76b58c1d1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:16.943577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe723a8-35fb-440b-a745-11a5df5e2654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:16.944233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe723a8-35fb-440b-a745-11a5df5e2654 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:16.944519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe723a8-35fb-440b-a745-11a5df5e2654 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:16.944794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe723a8-35fb-440b-a745-11a5df5e2654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:16.945658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe723a8-35fb-440b-a745-11a5df5e2654 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.domain.id=default, user.id=baef3d38cf16460a9e38da424a63acd8) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:16.945990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe723a8-35fb-440b-a745-11a5df5e2654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:16.947392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe723a8-35fb-440b-a745-11a5df5e2654 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:16.954161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1322 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/role_assignments?user.id=baef3d38cf16460a9e38da424a63acd8&scope.domain.id=default&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:16.954963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:19.190929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ae64a-ab6d-4482-baad-f88fa3a1d984 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.191949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ae64a-ab6d-4482-baad-f88fa3a1d984 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.192456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ae64a-ab6d-4482-baad-f88fa3a1d984 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.194083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:19.207844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b8b3b-d75b-44fc-97a8-2293e6170ce4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.208308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b8b3b-d75b-44fc-97a8-2293e6170ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.208514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b8b3b-d75b-44fc-97a8-2293e6170ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.230658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-bf0b8b3b-d75b-44fc-97a8-2293e6170ce4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:19.231859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bf0b8b3b-d75b-44fc-97a8-2293e6170ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:19.252910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617bb5-9dc3-4b35-99c3-09097f1d2e4c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.253532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617bb5-9dc3-4b35-99c3-09097f1d2e4c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.254033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617bb5-9dc3-4b35-99c3-09097f1d2e4c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.255898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 13/23] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:19.261287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8ce9c-4cfd-4624-a77f-b83f0eac2595 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.261847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8ce9c-4cfd-4624-a77f-b83f0eac2595 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.262321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8ce9c-4cfd-4624-a77f-b83f0eac2595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.298473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-35e8ce9c-4cfd-4624-a77f-b83f0eac2595 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:19.300026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-35e8ce9c-4cfd-4624-a77f-b83f0eac2595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:19.353438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:19.402159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b8b3b-d75b-44fc-97a8-2293e6170ce4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:19.477927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:19.480300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:19.518544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8ce9c-4cfd-4624-a77f-b83f0eac2595 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:19.544881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b8b3b-d75b-44fc-97a8-2293e6170ce4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:19.594710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:19.595884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.596368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.596837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.614357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:19.621485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:05:19.649959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:19.650808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:19.651609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:05:19.651609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:05:19.651609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:05:19.651609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:19.653643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 12/26] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:19.660465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:19.686554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:19.698317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8ce9c-4cfd-4624-a77f-b83f0eac2595 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:19.766455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:19.767271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.767560 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.767839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.782631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:19.790653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:19.791497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:19.792263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:19.794618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 15/27] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:19.801180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:19.903347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72360a3-7d3e-4637-80d4-16a295c1acb7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:19.919412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:19.925702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18359f-7044-4add-970a-f96ee8148e7d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:19.941786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc7025-f011-404a-80e9-55facf5ebaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:19.942841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7025-f011-404a-80e9-55facf5ebaff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.943327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7025-f011-404a-80e9-55facf5ebaff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.943812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7025-f011-404a-80e9-55facf5ebaff None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.944790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc7025-f011-404a-80e9-55facf5ebaff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:19.945295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc7025-f011-404a-80e9-55facf5ebaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:19.946905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc7025-f011-404a-80e9-55facf5ebaff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:19.949754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:19.961599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 16/28] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:19.963299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1075af-e18a-4a64-bbd7-7e9e3ed7e5ea None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:19.963802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1075af-e18a-4a64-bbd7-7e9e3ed7e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:19.964532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1075af-e18a-4a64-bbd7-7e9e3ed7e5ea None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:19.966273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 17/29] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:19.968061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1075af-e18a-4a64-bbd7-7e9e3ed7e5ea None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:20.018266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61aa16-4ff6-47b5-9023-dd1185626a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:20.018862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61aa16-4ff6-47b5-9023-dd1185626a52 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.019148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61aa16-4ff6-47b5-9023-dd1185626a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.019420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61aa16-4ff6-47b5-9023-dd1185626a52 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.020307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61aa16-4ff6-47b5-9023-dd1185626a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:20.020755 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61aa16-4ff6-47b5-9023-dd1185626a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:20.022329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61aa16-4ff6-47b5-9023-dd1185626a52 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:20.038980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 13/30] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:20.040690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc172-9db4-4ad9-933c-ef33850b1bd3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.041182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc172-9db4-4ad9-933c-ef33850b1bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.041685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc172-9db4-4ad9-933c-ef33850b1bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.060796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-1e1cc172-9db4-4ad9-933c-ef33850b1bd3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:20.062770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1e1cc172-9db4-4ad9-933c-ef33850b1bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:20.075424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1075af-e18a-4a64-bbd7-7e9e3ed7e5ea None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:20.112494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71c5f-c405-49fc-b75c-5d39d7c29cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:20.113429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71c5f-c405-49fc-b75c-5d39d7c29cff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.113819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71c5f-c405-49fc-b75c-5d39d7c29cff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.114098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71c5f-c405-49fc-b75c-5d39d7c29cff None admin] PATH_INFO: `/v3/users/baef3d38cf16460a9e38da424a63acd8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.115486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71c5f-c405-49fc-b75c-5d39d7c29cff None admin] RBAC: Authorizing `identity:get_user(user_id=baef3d38cf16460a9e38da424a63acd8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:20.117142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71c5f-c405-49fc-b75c-5d39d7c29cff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:20.119078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 18/31] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:19 2022] GET /identity/v3/users/baef3d38cf16460a9e38da424a63acd8 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:20.120397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599fe6-f713-4c77-bc19-697ff7731f16 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.120840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599fe6-f713-4c77-bc19-697ff7731f16 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.121290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599fe6-f713-4c77-bc19-697ff7731f16 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.122858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 19/32] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:20.128079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599fe6-f713-4c77-bc19-697ff7731f16 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:20.154806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 14/33] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:20.156926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9ce3-314a-48f5-8ff7-15c9f54c9208 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.157392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9ce3-314a-48f5-8ff7-15c9f54c9208 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.157779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9ce3-314a-48f5-8ff7-15c9f54c9208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.181522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b34b9ce3-314a-48f5-8ff7-15c9f54c9208 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:20.183397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b34b9ce3-314a-48f5-8ff7-15c9f54c9208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:20.205138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:20.258248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599fe6-f713-4c77-bc19-697ff7731f16 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:20.271977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 15/34] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:20.277924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9ce3-314a-48f5-8ff7-15c9f54c9208 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:20.308603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:20.321789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:20.322948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.323651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.324098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.325655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:20.327310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:20.401717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9ce3-314a-48f5-8ff7-15c9f54c9208 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:20.436726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:20.438077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.438376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.438691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.440176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:20.441705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:20.448202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 16/35] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:20.449092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:20.493858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 20/36] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/projects => generated 301 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:20.495357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:20.539461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:20.557879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad629-609d-4f9a-9d5d-bb74ea0b5427 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:20.598691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead814e2-462d-44de-aff8-8cf086325a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:20.599378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead814e2-462d-44de-aff8-8cf086325a78 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.599663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead814e2-462d-44de-aff8-8cf086325a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.599944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead814e2-462d-44de-aff8-8cf086325a78 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.600725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead814e2-462d-44de-aff8-8cf086325a78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:20.602205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead814e2-462d-44de-aff8-8cf086325a78 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:20.711817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4728c44-765f-43be-a9c9-6d9b2e4e7071 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:20.730225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:20.747882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:20.748615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.749042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.749321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.750725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:20.752261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:20.770972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 21/37] 10.222.0.47 () {60 vars in 1131 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/roles => generated 225 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:20.772150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:20.775812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 17/38] 10.222.0.47 () {60 vars in 1131 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/roles => generated 219 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:20.777641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d12771-e455-48d4-a52a-4311d904107b None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.777941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d12771-e455-48d4-a52a-4311d904107b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.778544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d12771-e455-48d4-a52a-4311d904107b None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.780010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 18/39] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:20.786127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c6104-edc6-4d87-ba0b-218f9cc2c4e3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.786566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c6104-edc6-4d87-ba0b-218f9cc2c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.786952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c6104-edc6-4d87-ba0b-218f9cc2c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.809102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-032c6104-edc6-4d87-ba0b-218f9cc2c4e3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:20.811063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-032c6104-edc6-4d87-ba0b-218f9cc2c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:20.898656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1cd8a-b118-4158-852b-f1494ae83128 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:20.900746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 19/40] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:20.936059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c6104-edc6-4d87-ba0b-218f9cc2c4e3 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:20.940333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194106e-643c-4319-b664-bb3e455165cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:20.941491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194106e-643c-4319-b664-bb3e455165cf None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.941925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194106e-643c-4319-b664-bb3e455165cf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.942351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194106e-643c-4319-b664-bb3e455165cf None admin] PATH_INFO: `/v3/domains/default/users/baef3d38cf16460a9e38da424a63acd8/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.944825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194106e-643c-4319-b664-bb3e455165cf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=baef3d38cf16460a9e38da424a63acd8, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:20.946547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194106e-643c-4319-b664-bb3e455165cf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:20.974076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 22/41] 10.222.0.47 () {58 vars in 1361 bytes} [Thu Jun 30 13:05:20 2022] PUT /identity/v3/domains/default/users/baef3d38cf16460a9e38da424a63acd8/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:20.975691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335600e-d258-403c-bbf0-ad3c8e70dba2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.975979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335600e-d258-403c-bbf0-ad3c8e70dba2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.976320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335600e-d258-403c-bbf0-ad3c8e70dba2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:20.977926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 23/42] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:20.986836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503051f-8daa-4a9d-a828-098217cba112 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:20.987127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503051f-8daa-4a9d-a828-098217cba112 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:20.987414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503051f-8daa-4a9d-a828-098217cba112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:21.013982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2503051f-8daa-4a9d-a828-098217cba112 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:21.017298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2503051f-8daa-4a9d-a828-098217cba112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:21.061254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:21.073246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:21.107389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c6104-edc6-4d87-ba0b-218f9cc2c4e3 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:21.129222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 24/43] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:21.148403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:21.149147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:21.149438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:21.149804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:21.152763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:21.152900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503051f-8daa-4a9d-a828-098217cba112 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:21.153183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:21.170219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 20/44] 10.222.0.47 () {60 vars in 1131 bytes} [Thu Jun 30 13:05:20 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:05:21.382802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503051f-8daa-4a9d-a828-098217cba112 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:21.417512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a72bd-455a-4d26-bbe9-982749c637d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:21.418318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a72bd-455a-4d26-bbe9-982749c637d9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:21.418602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a72bd-455a-4d26-bbe9-982749c637d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:21.418880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a72bd-455a-4d26-bbe9-982749c637d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:21.420026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a72bd-455a-4d26-bbe9-982749c637d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:21.421528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a72bd-455a-4d26-bbe9-982749c637d9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:21.423142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 25/45] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:21.428680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:21.527165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f329b07-c75b-4989-acc2-e04c4b03fa94 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:21.559856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d30e86-ba8c-4163-9efe-7c1c954c4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:21.560516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d30e86-ba8c-4163-9efe-7c1c954c4325 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:21.560802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d30e86-ba8c-4163-9efe-7c1c954c4325 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:21.561078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d30e86-ba8c-4163-9efe-7c1c954c4325 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:21.561835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d30e86-ba8c-4163-9efe-7c1c954c4325 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:21.563289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d30e86-ba8c-4163-9efe-7c1c954c4325 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:21.567695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:21.591493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 21/46] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:05:21 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:05:23.076181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4662f-f2dd-487b-9e5c-99d0857135b0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.076741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4662f-f2dd-487b-9e5c-99d0857135b0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.076741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4662f-f2dd-487b-9e5c-99d0857135b0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.078864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 26/47] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:23.084393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1eec-3395-451b-8d37-12f372d73e80 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.084804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1eec-3395-451b-8d37-12f372d73e80 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.085039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1eec-3395-451b-8d37-12f372d73e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.102492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e20b1eec-3395-451b-8d37-12f372d73e80 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:23.103692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e20b1eec-3395-451b-8d37-12f372d73e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:23.168878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 22/48] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:23.192613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4662f-f2dd-487b-9e5c-99d0857135b0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:23.227958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:23.293425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4662f-f2dd-487b-9e5c-99d0857135b0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:23.326467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:23.327190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.327477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.328376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.338717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:23.346715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:23.347577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:23.348549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 27/49] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:23.354116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1eec-3395-451b-8d37-12f372d73e80 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:23.449835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1eec-3395-451b-8d37-12f372d73e80 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:23.467348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:23.484663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33b6d1-28bc-4cae-8250-a128090826eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:23.485329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b6d1-28bc-4cae-8250-a128090826eb None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.485649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b6d1-28bc-4cae-8250-a128090826eb None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.485931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b6d1-28bc-4cae-8250-a128090826eb None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.486679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33b6d1-28bc-4cae-8250-a128090826eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:23.486991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33b6d1-28bc-4cae-8250-a128090826eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:23.488378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33b6d1-28bc-4cae-8250-a128090826eb None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:23.500466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 23/50] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:23.506119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:23.583045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ff66-bb4f-4de4-8314-a9448656ede5 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.583262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ff66-bb4f-4de4-8314-a9448656ede5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.583541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ff66-bb4f-4de4-8314-a9448656ede5 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.584906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 24/51] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:23.590023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5ac1-6336-43d0-9d82-bf8b5ae62046 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.590314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5ac1-6336-43d0-9d82-bf8b5ae62046 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.590596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5ac1-6336-43d0-9d82-bf8b5ae62046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.599356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:23.607546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7d5e5ac1-6336-43d0-9d82-bf8b5ae62046 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:23.608750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7d5e5ac1-6336-43d0-9d82-bf8b5ae62046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:23.610006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76b0e-5dad-4a90-b044-6e8365de96fa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:23.643207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:23.644078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.644370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.644649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] PATH_INFO: `/v3/users/baef3d38cf16460a9e38da424a63acd8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.645858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] RBAC: Authorizing `identity:get_user(user_id=baef3d38cf16460a9e38da424a63acd8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:23.647306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:23.648952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 28/52] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:23 2022] GET /identity/v3/users/baef3d38cf16460a9e38da424a63acd8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:23.654657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:23.760228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee729-4d4a-4062-b1b9-d015265b6cfd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:23.778721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 25/53] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:23.792893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:23.793718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.794007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.794285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.795461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:23.797433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:23.799241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 29/54] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:23.801841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5ac1-6336-43d0-9d82-bf8b5ae62046 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:23.804546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:23.834439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:23.899846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5ac1-6336-43d0-9d82-bf8b5ae62046 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:23.902577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba287-dfb4-41a4-a497-5f8ef8c259ad None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:23.910570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:23.934821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:23.935612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.935898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.936177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.937329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:23.937676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46190187-3d0b-4bf8-a065-df9e03148abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:23.938329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46190187-3d0b-4bf8-a065-df9e03148abd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:23.938619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46190187-3d0b-4bf8-a065-df9e03148abd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:23.938816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:23.938911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46190187-3d0b-4bf8-a065-df9e03148abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:23.939719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46190187-3d0b-4bf8-a065-df9e03148abd None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.domain.id=default, user.id=baef3d38cf16460a9e38da424a63acd8) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:23.940037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46190187-3d0b-4bf8-a065-df9e03148abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:23.940423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 26/55] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:23.941567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46190187-3d0b-4bf8-a065-df9e03148abd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:23.945922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:23.947468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 30/56] 10.222.0.47 () {56 vars in 1322 bytes} [Thu Jun 30 13:05:23 2022] GET /identity/v3/role_assignments?user.id=baef3d38cf16460a9e38da424a63acd8&scope.domain.id=default&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:24.050546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70106-d8a4-4e23-94d9-44e3e344eb81 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:24.088197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0021105-71a6-40f9-b7cf-e5320b8c9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:24.088810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0021105-71a6-40f9-b7cf-e5320b8c9bd8 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:24.089311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0021105-71a6-40f9-b7cf-e5320b8c9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:24.089620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0021105-71a6-40f9-b7cf-e5320b8c9bd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:24.090349 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0021105-71a6-40f9-b7cf-e5320b8c9bd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:24.091790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0021105-71a6-40f9-b7cf-e5320b8c9bd8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:24.119788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 27/57] 10.222.0.47 () {60 vars in 1140 bytes} [Thu Jun 30 13:05:23 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:05:26.132082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8f22-87fc-492e-99a2-18940a8f534c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:26.132599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8f22-87fc-492e-99a2-18940a8f534c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:26.132680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8f22-87fc-492e-99a2-18940a8f534c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:26.134047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 31/58] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:26.139174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d8442-7584-4c9b-a737-e13667bebc82 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:26.139561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d8442-7584-4c9b-a737-e13667bebc82 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:26.139756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d8442-7584-4c9b-a737-e13667bebc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:26.156627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9a8d8442-7584-4c9b-a737-e13667bebc82 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:26.157857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9a8d8442-7584-4c9b-a737-e13667bebc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:26.180817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:26.224893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 28/59] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:26.248677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8f22-87fc-492e-99a2-18940a8f534c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:26.340450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:26.348275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8f22-87fc-492e-99a2-18940a8f534c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:26.380535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7d4c6-7321-42c2-8262-30aae148c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:26.381314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7d4c6-7321-42c2-8262-30aae148c004 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:26.381626 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7d4c6-7321-42c2-8262-30aae148c004 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:26.381904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7d4c6-7321-42c2-8262-30aae148c004 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:26.383107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7d4c6-7321-42c2-8262-30aae148c004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:26.384507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7d4c6-7321-42c2-8262-30aae148c004 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:26.386129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 32/60] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:26.392141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d8442-7584-4c9b-a737-e13667bebc82 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:26.487783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d8442-7584-4c9b-a737-e13667bebc82 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:26.521077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a45ce6-fea3-4f5d-ba53-7b9b0ddab24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:26.521764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45ce6-fea3-4f5d-ba53-7b9b0ddab24c None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:26.522054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45ce6-fea3-4f5d-ba53-7b9b0ddab24c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:26.522333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45ce6-fea3-4f5d-ba53-7b9b0ddab24c None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:26.523045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a45ce6-fea3-4f5d-ba53-7b9b0ddab24c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:26.524502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a45ce6-fea3-4f5d-ba53-7b9b0ddab24c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:26.549340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 29/61] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:05:26 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:29.657858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d23c6-0091-411c-a834-4aba528c2fd0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:29.658350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d23c6-0091-411c-a834-4aba528c2fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:29.658350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d23c6-0091-411c-a834-4aba528c2fd0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:29.659686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 33/62] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:29.664940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b1d8-27b1-4eba-a223-3fcbb695134b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:29.665726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b1d8-27b1-4eba-a223-3fcbb695134b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:29.666146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b1d8-27b1-4eba-a223-3fcbb695134b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:29.694439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-1df5b1d8-27b1-4eba-a223-3fcbb695134b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:29.695821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1df5b1d8-27b1-4eba-a223-3fcbb695134b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:29.707055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:29.767210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940cf24-d64e-4add-811c-51ce9e35adea None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:29.767720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940cf24-d64e-4add-811c-51ce9e35adea None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:29.768165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940cf24-d64e-4add-811c-51ce9e35adea None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:29.769707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 34/63] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:29.785533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498c07-5a7c-4555-8fd1-e12f8c12239f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:29.786003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498c07-5a7c-4555-8fd1-e12f8c12239f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:29.786423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498c07-5a7c-4555-8fd1-e12f8c12239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:29.794260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 30/64] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:29.814434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8d498c07-5a7c-4555-8fd1-e12f8c12239f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:29.815829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8d498c07-5a7c-4555-8fd1-e12f8c12239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:29.821078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5b1d8-27b1-4eba-a223-3fcbb695134b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:29.937677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5b1d8-27b1-4eba-a223-3fcbb695134b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:29.948746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 35/65] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 30 13:05:29.950384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d5edb-90f5-440c-ad5d-df6fc76d9d32 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:29.950825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d5edb-90f5-440c-ad5d-df6fc76d9d32 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:29.951245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d5edb-90f5-440c-ad5d-df6fc76d9d32 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:29.952835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 36/66] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:29.958409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7dc6-6abb-40f8-a317-bfbef493cb55 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:29.958891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7dc6-6abb-40f8-a317-bfbef493cb55 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:29.959317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7dc6-6abb-40f8-a317-bfbef493cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:29.975879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:29.976909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:29.977430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:29.978002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:29.984464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-447b7dc6-6abb-40f8-a317-bfbef493cb55 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:29.985887 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-447b7dc6-6abb-40f8-a317-bfbef493cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:29.990933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:30.000402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:30.001275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:30.002455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:30.007797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 31/67] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:30.007797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.019230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.071064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 37/68] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:30.071779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7dc6-6abb-40f8-a317-bfbef493cb55 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.099517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.132744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d754d3-c940-4053-a0da-2b782f044e62 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.168908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1beb34-1d86-41f7-86ed-73d388dfd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.170009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1beb34-1d86-41f7-86ed-73d388dfd403 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.170304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1beb34-1d86-41f7-86ed-73d388dfd403 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.170586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1beb34-1d86-41f7-86ed-73d388dfd403 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.180789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7dc6-6abb-40f8-a317-bfbef493cb55 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.184501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1beb34-1d86-41f7-86ed-73d388dfd403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-2f1beb34-1d86-41f7-86ed-73d388dfd403 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:30.193995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:30.194966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:30.195893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:30.197851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 32/69] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:30.199202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fc00-3a17-4e08-9572-545886d6d786 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.199490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fc00-3a17-4e08-9572-545886d6d786 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.199829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fc00-3a17-4e08-9572-545886d6d786 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.201277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 33/70] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:30.201817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fc00-3a17-4e08-9572-545886d6d786 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.226539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13388246-f9e3-4c55-889a-59e8d8ffb10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.227302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13388246-f9e3-4c55-889a-59e8d8ffb10a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.227684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13388246-f9e3-4c55-889a-59e8d8ffb10a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.228044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13388246-f9e3-4c55-889a-59e8d8ffb10a None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.228878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13388246-f9e3-4c55-889a-59e8d8ffb10a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:30.229261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13388246-f9e3-4c55-889a-59e8d8ffb10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:30.230766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13388246-f9e3-4c55-889a-59e8d8ffb10a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:30.240017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 38/71] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:30.241498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43049-b482-46de-aee9-14e52b06813b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.241934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43049-b482-46de-aee9-14e52b06813b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.242357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43049-b482-46de-aee9-14e52b06813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.258691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d3d43049-b482-46de-aee9-14e52b06813b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:30.259906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d3d43049-b482-46de-aee9-14e52b06813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:30.292889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.337485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 39/72] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:30.337485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43049-b482-46de-aee9-14e52b06813b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.346079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fc00-3a17-4e08-9572-545886d6d786 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.347293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.391051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f05361-b249-4745-9721-f3122fae664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.391858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f05361-b249-4745-9721-f3122fae664d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.392159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f05361-b249-4745-9721-f3122fae664d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.392419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f05361-b249-4745-9721-f3122fae664d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.393826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f05361-b249-4745-9721-f3122fae664d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:30.395311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f05361-b249-4745-9721-f3122fae664d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:30.397515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 34/73] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:30.397732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f05361-b249-4745-9721-f3122fae664d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.443254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43049-b482-46de-aee9-14e52b06813b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.478867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.479463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.479753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.480035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.480793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:30.481109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:30.482553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:30.490550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 40/74] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:30.491338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.506006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f05361-b249-4745-9721-f3122fae664d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.539931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.540791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.541084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.541363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] PATH_INFO: `/v3/users/baef3d38cf16460a9e38da424a63acd8` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.542839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] RBAC: Authorizing `identity:get_user(user_id=baef3d38cf16460a9e38da424a63acd8)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:30.544304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:30.545967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 35/75] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/users/baef3d38cf16460a9e38da424a63acd8 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:30.546737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.549280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.571365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.596184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701cbb5-c77e-44fa-9ee9-f7610cb71638 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.628921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06702cd0-5279-4c06-b9bf-8fbedf93d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.629754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702cd0-5279-4c06-b9bf-8fbedf93d75a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.630041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702cd0-5279-4c06-b9bf-8fbedf93d75a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.630325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702cd0-5279-4c06-b9bf-8fbedf93d75a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.640684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06702cd0-5279-4c06-b9bf-8fbedf93d75a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:30.647382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53add-1285-4a9a-a46d-8f2df87199d0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-06702cd0-5279-4c06-b9bf-8fbedf93d75a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:30.648762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:30.649635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:30.650392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 41/76] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:30.651496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c3db1-e53e-4625-be9e-0e0516da0854 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.651597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c3db1-e53e-4625-be9e-0e0516da0854 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.651828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c3db1-e53e-4625-be9e-0e0516da0854 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.653102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 42/77] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:30.653834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c3db1-e53e-4625-be9e-0e0516da0854 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.683764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.684435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.684720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.684999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.685742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:30.687723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:30.707549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 36/78] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:05:30 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:30.708456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.779698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.783797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c3db1-e53e-4625-be9e-0e0516da0854 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.823399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.824396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.824688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.824962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.829994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:30.835635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaceda-b838-4be8-975a-fdb108213e6c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:30.842982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:30.844552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:30.846571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 43/79] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:30.847209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:30.876691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:30.877354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:30.877670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:30.878708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:30.959811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:30.961814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:30.973248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f8f26-d751-48bc-95f6-08e0df0e2690 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.024036 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b01419-671a-4edd-a754-4bfb8065ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.024971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01419-671a-4edd-a754-4bfb8065ac05 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.025420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01419-671a-4edd-a754-4bfb8065ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.025725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01419-671a-4edd-a754-4bfb8065ac05 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.026486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01419-671a-4edd-a754-4bfb8065ac05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:31.026798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01419-671a-4edd-a754-4bfb8065ac05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.028173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01419-671a-4edd-a754-4bfb8065ac05 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.036140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.038865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 44/80] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:31.040412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdb2f-74ce-4b73-9827-c40aa6aa12c8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.040716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdb2f-74ce-4b73-9827-c40aa6aa12c8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.041081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdb2f-74ce-4b73-9827-c40aa6aa12c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.060492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-006fdb2f-74ce-4b73-9827-c40aa6aa12c8 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:31.062895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-006fdb2f-74ce-4b73-9827-c40aa6aa12c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:31.098864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 37/81] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:31.100170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.121025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.139612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 45/82] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:31.140654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fdb2f-74ce-4b73-9827-c40aa6aa12c8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.220272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612289c-06fd-4527-857d-5c8b5d2bf5d1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.243571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fdb2f-74ce-4b73-9827-c40aa6aa12c8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.257968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.258627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.259014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.259294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.279414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.280297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.280623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.280905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.282142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.283589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.285423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 46/83] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:31.286108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.288760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.334605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.336082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.349926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.399148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f18-9c34-4ce0-8a16-885a9d4ae9dd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.436406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.437661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.438170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.438653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.440070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.441808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.442846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 38/84] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:31.444110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 47/85] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:31.445172 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.448205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.511137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.551023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1c2b9-ba35-47f4-ba95-38a4c2dcadd9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.555379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b95a6-0585-409f-91ed-7289015c339a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.575092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.590384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.591151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.591440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.591813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.602755 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.603565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.603850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.604132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.616599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:31.625326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:31.626228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:31.627414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 39/86] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:31.628268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.668945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.670811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.739452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7940f-a932-442f-894a-fd6ad8ef74dd None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.758139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.774769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 48/87] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:31.776028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.777347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.778290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.778577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.778874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.780802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.782082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.783922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 40/88] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:31.784521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.803168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:31.882072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab61fb-e891-41e1-9de5-1e1f895b808c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.898034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4547ae-c2a7-4e88-92cf-c56a675b1e5a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:31.917344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.918297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.918783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.919279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.920305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=baef3d38cf16460a9e38da424a63acd8) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:31.920855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.923035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.928955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 49/89] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/role_assignments?user.id=baef3d38cf16460a9e38da424a63acd8&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:31.930121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:31.935146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:31.935838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:31.936131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:31.936412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:31.937864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:31.938179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:31.939627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:31.950041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 41/90] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:31.950979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:32.007575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:32.027721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:32.045237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11ee4-f4d5-4ca2-851c-c9cc6158e314 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:32.070984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6e6a-e970-49b8-a001-4c7d5148e563 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:32.086518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:32.087763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:32.088249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:32.088739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:32.090474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:32.092127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:32.094258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 50/91] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:32.095381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:32.121615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:32.122292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:32.122577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:32.122861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:32.123732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=902653d053d145c0a81595daf27e2533) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:32.124018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:32.126242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:32.144471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 42/92] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:31 2022] GET /identity/v3/role_assignments?user.id=902653d053d145c0a81595daf27e2533&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:32.145134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:32.209967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15cbad-deae-44d5-bad1-771795531cb7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:32.257637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:32.258910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:32.259402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:32.259882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:32.266393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:32.268284 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:32.270608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 51/93] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:32 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:32.275867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:32.303967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6ff75-74b5-452d-a610-c0237f815b15 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:32.312643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:32.320833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:32.346453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:32.347044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:32.347330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:32.347615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:32.348453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] RBAC: Adding query filter params (role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=902653d053d145c0a81595daf27e2533) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:32.348768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:32.350469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:32.356645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 43/94] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:32 2022] GET /identity/v3/role_assignments?user.id=902653d053d145c0a81595daf27e2533&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:32.409428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dbfa1-9fac-4633-951e-604d46dba58e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:32.447334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:32.448007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:32.448295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:32.448575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:32.524129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:32.525659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:32.551745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:32.634619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 52/95] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:32.640470 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:32.768643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61c25-75e9-453b-88da-0bdc4f75f0b9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:32.809356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81be4f-c544-423b-9890-78c4d3fe07a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:32.810263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81be4f-c544-423b-9890-78c4d3fe07a0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:32.810554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81be4f-c544-423b-9890-78c4d3fe07a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:32.810836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81be4f-c544-423b-9890-78c4d3fe07a0 None admin] PATH_INFO: `/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:32.814268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81be4f-c544-423b-9890-78c4d3fe07a0 None admin] RBAC: Authorizing `identity:get_project(project_id=16d8dab7ef7e49aa8404ced10f6a464f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:32.815761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81be4f-c544-423b-9890-78c4d3fe07a0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:32.817971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 44/96] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:32 2022] GET /identity/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:32.823707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:32.985951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90c2b-5d2b-46ad-bb93-abd792caffe1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:33.016524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:33.029047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457735f5-27f3-4197-9df1-d47711f2cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:33.029954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457735f5-27f3-4197-9df1-d47711f2cc6d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.030390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457735f5-27f3-4197-9df1-d47711f2cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.030847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457735f5-27f3-4197-9df1-d47711f2cc6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.031861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457735f5-27f3-4197-9df1-d47711f2cc6d None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=16d8dab7ef7e49aa8404ced10f6a464f, user.id=902653d053d145c0a81595daf27e2533) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:33.032322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457735f5-27f3-4197-9df1-d47711f2cc6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:33.033934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457735f5-27f3-4197-9df1-d47711f2cc6d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:33.040016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 53/97] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:32 2022] GET /identity/v3/role_assignments?user.id=902653d053d145c0a81595daf27e2533&scope.project.id=16d8dab7ef7e49aa8404ced10f6a464f&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:33.233310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab23e-5d82-4e33-a147-14b9675e6056 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.233930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab23e-5d82-4e33-a147-14b9675e6056 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.234355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab23e-5d82-4e33-a147-14b9675e6056 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.235880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 45/98] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:33.241309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b975b4-0d9d-4f48-918f-f38b25958a01 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.241570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b975b4-0d9d-4f48-918f-f38b25958a01 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.241861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b975b4-0d9d-4f48-918f-f38b25958a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.263214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-46b975b4-0d9d-4f48-918f-f38b25958a01 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:33.264469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46b975b4-0d9d-4f48-918f-f38b25958a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:33.348231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 54/99] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:33.393221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab23e-5d82-4e33-a147-14b9675e6056 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:33.424649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4eed5-6a7e-4aae-9e3c-5c01140f9bbe None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.424943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4eed5-6a7e-4aae-9e3c-5c01140f9bbe None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.425232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4eed5-6a7e-4aae-9e3c-5c01140f9bbe None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.426655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 55/100] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:33.442396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59960d-91b1-43c5-8b7b-2ed664acbade None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.442687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59960d-91b1-43c5-8b7b-2ed664acbade None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.442975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59960d-91b1-43c5-8b7b-2ed664acbade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.466217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:33.471791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8e59960d-91b1-43c5-8b7b-2ed664acbade None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:33.473008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8e59960d-91b1-43c5-8b7b-2ed664acbade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:33.557866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab23e-5d82-4e33-a147-14b9675e6056 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:33.593721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:33.594886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.595368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.595838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.597227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:33.598908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:33.600747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 46/101] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:33.612846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:33.619233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 56/102] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 30 13:05:33.659513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59960d-91b1-43c5-8b7b-2ed664acbade None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:33.750391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:33.804250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af954-6d5c-4310-af55-4927752c0087 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:33.826590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:33.847741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59960d-91b1-43c5-8b7b-2ed664acbade None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:33.868803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:33.869495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.869788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.870072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.870812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:33.872274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:33.908618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:33.909771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:33.910075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 47/103] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:05:33 2022] POST /identity/v3/projects => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:05:33.912922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:33.912922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:33.942584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:33.950776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:33.951725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:33.952546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 57/104] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:33.958004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:34.091718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb40c3-51a6-42ee-bf75-ad6a88bd8648 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:34.141737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:34.142836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:34.143341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:34.143875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:34.144900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:34.145478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:34.147136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:34.158476 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 48/105] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:34.164213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:34.285218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc91c-9629-4220-a5e8-0b1fe8acb595 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:34.292398 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:34.320975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:34.321897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:34.322183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:34.322463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] PATH_INFO: `/v3/users/090e9c670424405286a2416501f403dd` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:34.337301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] RBAC: Authorizing `identity:get_user(user_id=090e9c670424405286a2416501f403dd)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:34.338794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:34.340753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 58/106] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:34 2022] GET /identity/v3/users/090e9c670424405286a2416501f403dd => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:34.346933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:34.380260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:34.489273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2e31-bafe-4086-adae-c6399b1484d5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:34.528926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:34.529616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:34.529908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:34.530198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:34.610589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:34.611993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:34.644915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:34.727384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 49/107] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:34.733252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:34.876085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49540b2-e714-4489-83f6-1db94c9705f7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:34.918746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef68fb-af79-4309-a988-5bbc7805ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:34.919624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef68fb-af79-4309-a988-5bbc7805ba03 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:34.919906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef68fb-af79-4309-a988-5bbc7805ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:34.920182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef68fb-af79-4309-a988-5bbc7805ba03 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:34.921937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef68fb-af79-4309-a988-5bbc7805ba03 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:34.923377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef68fb-af79-4309-a988-5bbc7805ba03 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:34.925070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 59/108] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:34 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:34.934565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:35.085362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cb29e-a9cf-46d0-b8a8-d1e1f800b537 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:35.115225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:35.124966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2551-efda-4e44-9597-df12899891f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:35.125655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2551-efda-4e44-9597-df12899891f3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:35.125945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2551-efda-4e44-9597-df12899891f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:35.126413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2551-efda-4e44-9597-df12899891f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:35.127201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d2551-efda-4e44-9597-df12899891f3 None admin] RBAC: Adding query filter params (role.id=e2fe0be6ceca48a8b32415b51c1cd36b, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=090e9c670424405286a2416501f403dd) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:35.127517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d2551-efda-4e44-9597-df12899891f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:35.128971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d2551-efda-4e44-9597-df12899891f3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:35.134544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 50/109] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:34 2022] GET /identity/v3/role_assignments?user.id=090e9c670424405286a2416501f403dd&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=e2fe0be6ceca48a8b32415b51c1cd36b => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:35.238940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9438b7-3873-4e9d-b858-1f5617f77aa0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:35.239279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9438b7-3873-4e9d-b858-1f5617f77aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:35.239514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9438b7-3873-4e9d-b858-1f5617f77aa0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:35.240891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 60/110] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:35.246477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567461d-aaba-4efc-9ef8-4c8ca761d99f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:35.246771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567461d-aaba-4efc-9ef8-4c8ca761d99f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:35.247052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567461d-aaba-4efc-9ef8-4c8ca761d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:35.265006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5567461d-aaba-4efc-9ef8-4c8ca761d99f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:35.266324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5567461d-aaba-4efc-9ef8-4c8ca761d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:35.382243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 51/111] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:35.416891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9438b7-3873-4e9d-b858-1f5617f77aa0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:35.453337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:35.543968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9438b7-3873-4e9d-b858-1f5617f77aa0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:35.583230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e7097-6243-47fb-86e7-2902d670df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:35.584031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7097-6243-47fb-86e7-2902d670df39 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:35.584317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7097-6243-47fb-86e7-2902d670df39 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:35.584593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7097-6243-47fb-86e7-2902d670df39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:35.595945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e7097-6243-47fb-86e7-2902d670df39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-958e7097-6243-47fb-86e7-2902d670df39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:35.603563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:35.604426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:35.605191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 61/112] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:35.610831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567461d-aaba-4efc-9ef8-4c8ca761d99f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:35.675246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a636c1d-136d-4e4f-b98c-64c386a02d45 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:35.675520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a636c1d-136d-4e4f-b98c-64c386a02d45 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:35.675727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a636c1d-136d-4e4f-b98c-64c386a02d45 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:35.677094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 62/113] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:35.682570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13482-ef0d-4588-a6af-5271328338f5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:35.682859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13482-ef0d-4588-a6af-5271328338f5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:35.683134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13482-ef0d-4588-a6af-5271328338f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:35.704936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-32c13482-ef0d-4588-a6af-5271328338f5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:35.707744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-32c13482-ef0d-4588-a6af-5271328338f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:35.773421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567461d-aaba-4efc-9ef8-4c8ca761d99f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:35.817428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:35.837439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 63/114] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:35.841499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:35.842188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:35.842478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:35.843056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:35.844274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:35.844590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:35.846020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:35.854612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 52/115] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:35.862593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13482-ef0d-4588-a6af-5271328338f5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:35.874897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:35.891673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:36.014351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a4c6-7120-4a41-a027-cb0aa85689e2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.049871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.050680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.050969 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.051249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.062504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:36.074949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:36.075855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:36.076737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 53/116] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:36.088462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.110073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13482-ef0d-4588-a6af-5271328338f5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.147627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:36.148592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8d948-6a36-49d0-a14b-430d93795733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.149635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8d948-6a36-49d0-a14b-430d93795733 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.150028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8d948-6a36-49d0-a14b-430d93795733 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.150380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8d948-6a36-49d0-a14b-430d93795733 None admin] PATH_INFO: `/v3/users/baef3d38cf16460a9e38da424a63acd8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.151801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8d948-6a36-49d0-a14b-430d93795733 None admin] RBAC: Authorizing `identity:get_user(user_id=baef3d38cf16460a9e38da424a63acd8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:36.153519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8d948-6a36-49d0-a14b-430d93795733 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:36.155322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 64/117] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:35 2022] GET /identity/v3/users/baef3d38cf16460a9e38da424a63acd8 => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:36.156686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6dcc5-3d27-4238-b5a9-b776ed18b4db None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.157076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6dcc5-3d27-4238-b5a9-b776ed18b4db None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.157477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6dcc5-3d27-4238-b5a9-b776ed18b4db None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.158851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 65/118] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:36.160002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404e960-6b88-40cc-a04b-9c459b0c85b1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.160366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404e960-6b88-40cc-a04b-9c459b0c85b1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.160722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404e960-6b88-40cc-a04b-9c459b0c85b1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.162288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 66/119] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:36.166406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c22d-e7b2-44d9-9c19-fc35cebf9ae2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.166406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c22d-e7b2-44d9-9c19-fc35cebf9ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.166406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c22d-e7b2-44d9-9c19-fc35cebf9ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.190899 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-04d9c22d-e7b2-44d9-9c19-fc35cebf9ae2 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:36.192625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-04d9c22d-e7b2-44d9-9c19-fc35cebf9ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:36.223878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0ea34-8b91-4c52-a6f9-203c729f2cd1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.272079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ce773-4f5c-4120-8e1d-73593d4406ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.273498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ce773-4f5c-4120-8e1d-73593d4406ea None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.274076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ce773-4f5c-4120-8e1d-73593d4406ea None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.274478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ce773-4f5c-4120-8e1d-73593d4406ea None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.275406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ce773-4f5c-4120-8e1d-73593d4406ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:36.275797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ce773-4f5c-4120-8e1d-73593d4406ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:36.277264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ce773-4f5c-4120-8e1d-73593d4406ea None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:36.278436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 67/120] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:36.280045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9c22d-e7b2-44d9-9c19-fc35cebf9ae2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.287256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 54/121] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:36.291967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d8a3-ab0d-4f3f-8c08-0bebd0ef1612 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.291967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d8a3-ab0d-4f3f-8c08-0bebd0ef1612 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.291967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d8a3-ab0d-4f3f-8c08-0bebd0ef1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.309329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0df5d8a3-ab0d-4f3f-8c08-0bebd0ef1612 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:36.310754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:36.313373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0df5d8a3-ab0d-4f3f-8c08-0bebd0ef1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:36.406976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 55/122] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:36.409937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d8a3-ab0d-4f3f-8c08-0bebd0ef1612 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.427486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9c22d-e7b2-44d9-9c19-fc35cebf9ae2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.462420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:36.471680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.473113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.473592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.474018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.476033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:36.477986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:36.480630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 68/123] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:36 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:36.481579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.545429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d8a3-ab0d-4f3f-8c08-0bebd0ef1612 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.595274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.596330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.596759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.597126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.598484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:36.599414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:36.602040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:36.610048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 56/124] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:36 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:36.610048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.618865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbeefe-d2c1-401a-97bd-5b5c895580f4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.655299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.656920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.657401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.657883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.669851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:36.683345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:36.684314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 69/125] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:36.685092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.732994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8beb82-12a2-4f4f-95f4-1cc2093de0a1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.735226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:36.770733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.771685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.771965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.772251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.783881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:36.789030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6880-ba86-48fb-970c-149f6e7fe34c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:36.792472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:36.793353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:36.794192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 57/126] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:05:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:36.794824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.833631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:36.834875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:36.835376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:36.835846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/baef3d38cf16460a9e38da424a63acd8/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:36.838137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55d54e19f7c488c94db31aee114ae9f, user_id=baef3d38cf16460a9e38da424a63acd8, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:36.840115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:36.857650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 70/127] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:36 2022] PUT /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/baef3d38cf16460a9e38da424a63acd8/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:36.859436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:36.874796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:36.970161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893e73-70ac-465e-87c8-f562f985d872 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.021450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.022458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.022752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.023035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.024392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.026064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.028009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 58/128] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:36 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:37.028941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.032469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2942eb-9960-474b-a9f1-cc8ad034e2d0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.067688 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:37.073396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a15bb7-b41b-4412-a47b-cce9f183a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.074136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a15bb7-b41b-4412-a47b-cce9f183a64c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.074484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a15bb7-b41b-4412-a47b-cce9f183a64c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.074773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a15bb7-b41b-4412-a47b-cce9f183a64c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.075531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a15bb7-b41b-4412-a47b-cce9f183a64c None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:37.075853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a15bb7-b41b-4412-a47b-cce9f183a64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.079836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a15bb7-b41b-4412-a47b-cce9f183a64c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.090164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 71/129] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:37.094875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431f46-da59-4673-9843-798c3d120dbf None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.095173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431f46-da59-4673-9843-798c3d120dbf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.095457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431f46-da59-4673-9843-798c3d120dbf None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.096857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 72/130] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:37.097535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70431f46-da59-4673-9843-798c3d120dbf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.158636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fd895-b430-44df-ac28-964791efb155 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.199189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:37.205379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.206948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.207673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.208650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.210002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:37.210532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.212247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70431f46-da59-4673-9843-798c3d120dbf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.212359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.225305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 59/131] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:05:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:37.230326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.255840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534b07e-a5a8-47fd-b106-5d55f415c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.256747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534b07e-a5a8-47fd-b106-5d55f415c7d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.257035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534b07e-a5a8-47fd-b106-5d55f415c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.257316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534b07e-a5a8-47fd-b106-5d55f415c7d0 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/902653d053d145c0a81595daf27e2533/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.259412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534b07e-a5a8-47fd-b106-5d55f415c7d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55d54e19f7c488c94db31aee114ae9f, user_id=902653d053d145c0a81595daf27e2533, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.260938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534b07e-a5a8-47fd-b106-5d55f415c7d0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.282066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 73/132] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:37 2022] PUT /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/902653d053d145c0a81595daf27e2533/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:37.283550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7af06-97e5-4732-8f7d-faef1df7a397 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.284550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7af06-97e5-4732-8f7d-faef1df7a397 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.284852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7af06-97e5-4732-8f7d-faef1df7a397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.308574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7ba7af06-97e5-4732-8f7d-faef1df7a397 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:37.310897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7ba7af06-97e5-4732-8f7d-faef1df7a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:37.356088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:37.372664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2743-a9d9-41df-9635-330e1669682f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.400146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 74/133] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:37.401451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7af06-97e5-4732-8f7d-faef1df7a397 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.427686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.428584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.428863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.429139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.430440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.431908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.433589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 60/134] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:37 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:37.438985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.481249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:37.539286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7af06-97e5-4732-8f7d-faef1df7a397 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.547413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdbe50-2a46-4816-ab55-c0649f6db684 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.586139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.586637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.586878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.586991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.587180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.588360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.588570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.589341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.589874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.590126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.591479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.592916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 61/135] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:37.593475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.593779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.595698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 75/136] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:37 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:37.597988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.633833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:37.728617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edc7f4-ed7e-4279-bdb9-d074ca063006 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.752761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac6d9-b4b5-42cd-96bb-829a298c0167 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.789013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.789904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.790248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.790528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] PATH_INFO: `/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.791769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] RBAC: Authorizing `identity:get_project(project_id=16d8dab7ef7e49aa8404ced10f6a464f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.794372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.802375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 62/137] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:37 2022] GET /identity/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:37.803218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.807865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:37.818220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb11f6-10e2-4012-b997-5e4e1b354c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.818906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb11f6-10e2-4012-b997-5e4e1b354c78 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.819198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb11f6-10e2-4012-b997-5e4e1b354c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.819492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb11f6-10e2-4012-b997-5e4e1b354c78 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.820231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb11f6-10e2-4012-b997-5e4e1b354c78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:37.821712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb11f6-10e2-4012-b997-5e4e1b354c78 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:37.850694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 76/138] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:05:37 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:37.851878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab232b-c347-4196-95ce-b7fa53216aec None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.852169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab232b-c347-4196-95ce-b7fa53216aec None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.853040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab232b-c347-4196-95ce-b7fa53216aec None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.854738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 77/139] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:37.858187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab232b-c347-4196-95ce-b7fa53216aec None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:37.938683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:37.948367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06587ad-081f-4578-9bee-42850b53772d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:37.995524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c788ea-2692-4642-ab99-7101739d3c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:37.996473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c788ea-2692-4642-ab99-7101739d3c37 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:37.996773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c788ea-2692-4642-ab99-7101739d3c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:37.997056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c788ea-2692-4642-ab99-7101739d3c37 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:37.998381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c788ea-2692-4642-ab99-7101739d3c37 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:38.000740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c788ea-2692-4642-ab99-7101739d3c37 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:38.002594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 63/140] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:37 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:38.003566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab232b-c347-4196-95ce-b7fa53216aec None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:38.003842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc44f9-8da0-4498-ab26-731b5717f557 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:38.004138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc44f9-8da0-4498-ab26-731b5717f557 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:38.004422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc44f9-8da0-4498-ab26-731b5717f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:38.041732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3bdc44f9-8da0-4498-ab26-731b5717f557 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:38.043795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3bdc44f9-8da0-4498-ab26-731b5717f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:38.058257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:38.059909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:38.060505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:38.060980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] PATH_INFO: `/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f/users/902653d053d145c0a81595daf27e2533/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:38.064097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] RBAC: Authorizing `identity:create_grant(project_id=16d8dab7ef7e49aa8404ced10f6a464f, user_id=902653d053d145c0a81595daf27e2533, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:38.066005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:38.105983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 78/141] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:37 2022] PUT /identity/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f/users/902653d053d145c0a81595daf27e2533/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:38.106873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:38.157230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 64/142] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:38.174297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:38.208789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc44f9-8da0-4498-ab26-731b5717f557 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:38.294981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4833f-9dbc-4128-b702-67cf32b09be5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:38.351835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:38.353226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:38.353226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:38.353365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/902653d053d145c0a81595daf27e2533/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:38.355692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] RBAC: Authorizing `identity:create_grant(project_id=c55d54e19f7c488c94db31aee114ae9f, user_id=902653d053d145c0a81595daf27e2533, role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:38.357162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:38.382500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 79/143] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:38 2022] PUT /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/902653d053d145c0a81595daf27e2533/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:38.389300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:38.399767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc44f9-8da0-4498-ab26-731b5717f557 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:38.451909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:38.452812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:38.453099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:38.453374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:38.474759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:38.482604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:38.483599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:38.485631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 65/144] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:38.490726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:38.633379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45500d09-7442-46f2-b89d-f4eb93d0ac6d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:38.635841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:38.673883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:38.674563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:38.674845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:38.675122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:38.675879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:38.676183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:38.677608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:38.687370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 80/145] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:38.692980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:38.820963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe446a3e-7f7a-4cc0-804d-d1ff556951bc None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:38.870196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:38.871462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:38.871949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:38.872425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] PATH_INFO: `/v3/users/090e9c670424405286a2416501f403dd` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:38.873964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] RBAC: Authorizing `identity:get_user(user_id=090e9c670424405286a2416501f403dd)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:38.876193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:38.878440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 66/146] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:38 2022] GET /identity/v3/users/090e9c670424405286a2416501f403dd => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:38.884076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:39.054119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa8b5a-6eef-448a-807b-6760aa705dd6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:39.091728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff9756-f0c7-4fa6-9d2e-696233038c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:39.093574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9756-f0c7-4fa6-9d2e-696233038c43 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:39.094064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9756-f0c7-4fa6-9d2e-696233038c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:39.094534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9756-f0c7-4fa6-9d2e-696233038c43 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:39.095986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff9756-f0c7-4fa6-9d2e-696233038c43 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:39.097682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff9756-f0c7-4fa6-9d2e-696233038c43 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:39.099942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 81/147] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:38 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:39.105311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:39.134575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:39.214382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283ffd-b030-439f-af2b-ff91c3c74142 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:39.250063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16c1e5-672d-4059-a113-58f3aa83362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:39.251312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16c1e5-672d-4059-a113-58f3aa83362d None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:39.251796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16c1e5-672d-4059-a113-58f3aa83362d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:39.252281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16c1e5-672d-4059-a113-58f3aa83362d None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/090e9c670424405286a2416501f403dd/roles/e2fe0be6ceca48a8b32415b51c1cd36b` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:39.256126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16c1e5-672d-4059-a113-58f3aa83362d None admin] RBAC: Authorizing `identity:create_grant(project_id=c55d54e19f7c488c94db31aee114ae9f, user_id=090e9c670424405286a2416501f403dd, role_id=e2fe0be6ceca48a8b32415b51c1cd36b)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:39.257862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16c1e5-672d-4059-a113-58f3aa83362d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:39.292531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 67/148] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:39 2022] PUT /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f/users/090e9c670424405286a2416501f403dd/roles/e2fe0be6ceca48a8b32415b51c1cd36b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:40.055399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8446bc-5b44-44ac-a796-47938a70412c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.056093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8446bc-5b44-44ac-a796-47938a70412c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.056609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8446bc-5b44-44ac-a796-47938a70412c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.058211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 82/149] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:40.070912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375133ae-64f3-415d-b804-69eb090ca720 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.071469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375133ae-64f3-415d-b804-69eb090ca720 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.071951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375133ae-64f3-415d-b804-69eb090ca720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.098502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-375133ae-64f3-415d-b804-69eb090ca720 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:40.100053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-375133ae-64f3-415d-b804-69eb090ca720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:40.178842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 68/150] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:40.221178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8446bc-5b44-44ac-a796-47938a70412c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:40.258727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:40.278317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9600a0-daa5-4fbb-84d6-1bbd96c1305f None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.278636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9600a0-daa5-4fbb-84d6-1bbd96c1305f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.278898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9600a0-daa5-4fbb-84d6-1bbd96c1305f None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.280966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 69/151] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:40.286724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2df36-7f36-4359-a21b-78b763c8abe3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.287014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2df36-7f36-4359-a21b-78b763c8abe3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.287293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2df36-7f36-4359-a21b-78b763c8abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.309540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8ea2df36-7f36-4359-a21b-78b763c8abe3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:40.310663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8ea2df36-7f36-4359-a21b-78b763c8abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:40.326423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:40.410525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8446bc-5b44-44ac-a796-47938a70412c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:40.449584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:40.450740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.451227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.451702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.466139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 70/152] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:40.470252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:40.483098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:40.484046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:40.485122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 83/153] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:40.490489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2df36-7f36-4359-a21b-78b763c8abe3 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:40.518701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:40.598939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2df36-7f36-4359-a21b-78b763c8abe3 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:40.643558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:40.644525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.644983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.645429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.646413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:40.646888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:40.648426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:40.661874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 71/154] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:40.666873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:40.671324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:40.700482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:40.715751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769959e-5e01-48fb-aea8-8574076ae8e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:40.770317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:40.771140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.771423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.771697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.787763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:40.799891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:40.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:40.806347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 84/155] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:40.810520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:40.823035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dd2ab-5d20-4abd-a2ed-d83339c7a52b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:40.874785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:40.875910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:40.876342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:40.876759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] PATH_INFO: `/v3/users/baef3d38cf16460a9e38da424a63acd8` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:40.878158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] RBAC: Authorizing `identity:get_user(user_id=baef3d38cf16460a9e38da424a63acd8)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:40.879769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:40.881568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 72/156] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:40 2022] GET /identity/v3/users/baef3d38cf16460a9e38da424a63acd8 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:40.886903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:40.960129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a981f-74f3-471c-a4fd-c19f66aecc4c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:40.996100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.031357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3752611-f83c-4718-957e-bd2938959639 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:41.036388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.041481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.041481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.041481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.041481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:41.041481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:41.041481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:41.057485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 85/157] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:41.059751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:41.087296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.088342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.089086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.089604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.091797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.172831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:41.174677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:41.238023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eedd8-458b-410f-91c3-6debed11dcf4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:41.245819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.285266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.286888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.287493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.288027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.289651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:41.291921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:41.293809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 86/158] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:41 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:41.294422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 73/159] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:05:41.302478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:41.302720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:41.458158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.473805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14754-df4d-4968-b2c8-751e3ea0f3b0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:41.491025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e1648-ab9c-45ba-8ad4-469083d8d1cf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:41.524536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.525192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.525503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.525780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.558792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.559672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.560063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.560346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.563734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:41.565290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:41.567370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 87/160] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:41 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:41.573175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:41.583028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.621073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:41.622592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:41.729394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 74/161] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:41.736456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:41.782187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2576-db05-419b-bab7-ad705b0b82eb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:41.847424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.848344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.849081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.849555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.850551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=baef3d38cf16460a9e38da424a63acd8) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:41.851018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:41.853077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:41.865126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 88/162] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:41 2022] GET /identity/v3/role_assignments?user.id=baef3d38cf16460a9e38da424a63acd8&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:41.904185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.945027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bd8b8-175c-43dd-a69d-89de7bee7589 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:41.992174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d3a91-f4e7-46ac-bcd2-919bc74f4f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.993036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3a91-f4e7-46ac-bcd2-919bc74f4f49 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.993317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3a91-f4e7-46ac-bcd2-919bc74f4f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.993616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3a91-f4e7-46ac-bcd2-919bc74f4f49 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.998179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d3a91-f4e7-46ac-bcd2-919bc74f4f49 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:42.000174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d3a91-f4e7-46ac-bcd2-919bc74f4f49 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:42.002216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 75/163] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:41 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:42.008357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:42.037969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:42.156621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6abc4-eb10-4732-99e2-8ed002bdc936 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:42.192090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58b32d-0b20-4a67-8b5b-8bfafd4df23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:42.193150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b32d-0b20-4a67-8b5b-8bfafd4df23a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:42.193663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b32d-0b20-4a67-8b5b-8bfafd4df23a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:42.194155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b32d-0b20-4a67-8b5b-8bfafd4df23a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:42.195197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58b32d-0b20-4a67-8b5b-8bfafd4df23a None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=902653d053d145c0a81595daf27e2533) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:42.195708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58b32d-0b20-4a67-8b5b-8bfafd4df23a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:42.197359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58b32d-0b20-4a67-8b5b-8bfafd4df23a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:42.204555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 89/164] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:42 2022] GET /identity/v3/role_assignments?user.id=902653d053d145c0a81595daf27e2533&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:42.263723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc9d2-eb08-4237-bf73-c8d4e497086b None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:42.264226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc9d2-eb08-4237-bf73-c8d4e497086b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:42.264226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc9d2-eb08-4237-bf73-c8d4e497086b None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:42.266143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 76/165] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:42.271842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29b96-f72d-40f1-9ab8-a69ef68bb3d0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:42.272847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29b96-f72d-40f1-9ab8-a69ef68bb3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:42.273336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29b96-f72d-40f1-9ab8-a69ef68bb3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:42.298661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-75e29b96-f72d-40f1-9ab8-a69ef68bb3d0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:42.299897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-75e29b96-f72d-40f1-9ab8-a69ef68bb3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:42.389445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 90/166] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:42.441481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdc9d2-eb08-4237-bf73-c8d4e497086b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:42.571275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdc9d2-eb08-4237-bf73-c8d4e497086b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:42.612402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:42.613607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:42.614114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:42.614594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:42.626025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:42.627249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:42.635441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:42.636427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:42.637433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:42.639957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 77/167] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:42.650600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e29b96-f72d-40f1-9ab8-a69ef68bb3d0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:42.669958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:42.784417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e29b96-f72d-40f1-9ab8-a69ef68bb3d0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:42.824740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7a520-aeda-4c68-9036-18e9d93b23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:42.825344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7a520-aeda-4c68-9036-18e9d93b23f8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:42.825655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7a520-aeda-4c68-9036-18e9d93b23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:42.825931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7a520-aeda-4c68-9036-18e9d93b23f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:42.826756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7a520-aeda-4c68-9036-18e9d93b23f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:42.827065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7a520-aeda-4c68-9036-18e9d93b23f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:42.828597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7a520-aeda-4c68-9036-18e9d93b23f8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:42.841805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 91/168] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:42.850530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:42.936016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809073-6ca8-49f3-abc3-8a5173844935 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:42.936361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809073-6ca8-49f3-abc3-8a5173844935 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:42.936632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809073-6ca8-49f3-abc3-8a5173844935 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:42.938049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 92/169] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:42.943260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62a899-49f4-4edf-96b4-210463ba446c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:42.943555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62a899-49f4-4edf-96b4-210463ba446c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:42.943841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62a899-49f4-4edf-96b4-210463ba446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:42.975198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8f62a899-49f4-4edf-96b4-210463ba446c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:42.976411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8f62a899-49f4-4edf-96b4-210463ba446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:43.005216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f45180-6d1d-4a82-84d0-b872cb8f1cea None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:43.066962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 93/170] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:43.070655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8d79-b1da-448c-9d71-6538817a2fc6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.070944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8d79-b1da-448c-9d71-6538817a2fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.071221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8d79-b1da-448c-9d71-6538817a2fc6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.072511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 94/171] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:43.079350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68afa6-8e39-4c78-a3f4-8e5135f26e92 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.081073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68afa6-8e39-4c78-a3f4-8e5135f26e92 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.081357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68afa6-8e39-4c78-a3f4-8e5135f26e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.084471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:43.085350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.085661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.085941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.088780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:43.090537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:43.094484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.101430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 78/172] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:42 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:43.102364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.117973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3c68afa6-8e39-4c78-a3f4-8e5135f26e92 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:43.119168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c68afa6-8e39-4c78-a3f4-8e5135f26e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:43.236348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.254902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 95/173] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:43.256087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68afa6-8e39-4c78-a3f4-8e5135f26e92 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.275380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166f48-3d06-45c8-8789-2c0a8b9636d9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:43.312720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450d328-3c09-4f82-8ca1-51763b2737c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:43.313836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450d328-3c09-4f82-8ca1-51763b2737c9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.314219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450d328-3c09-4f82-8ca1-51763b2737c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.314595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450d328-3c09-4f82-8ca1-51763b2737c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.326339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450d328-3c09-4f82-8ca1-51763b2737c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8450d328-3c09-4f82-8ca1-51763b2737c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:43.335253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:43.336280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:43.337346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 79/174] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:43.338201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5a2c-e47d-4def-b93c-571065713146 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.338201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5a2c-e47d-4def-b93c-571065713146 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.338201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5a2c-e47d-4def-b93c-571065713146 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.340736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 80/175] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:43.340736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5a2c-e47d-4def-b93c-571065713146 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.387258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68afa6-8e39-4c78-a3f4-8e5135f26e92 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:43.418233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.423498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:43.424595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.424883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.425160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.455838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5a2c-e47d-4def-b93c-571065713146 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:43.482212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.491160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340843b-986e-430c-b2dc-8d2dc1093d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:43.491949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340843b-986e-430c-b2dc-8d2dc1093d27 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.492234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340843b-986e-430c-b2dc-8d2dc1093d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.492511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340843b-986e-430c-b2dc-8d2dc1093d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.495587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:43.497045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:43.503102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340843b-986e-430c-b2dc-8d2dc1093d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-c340843b-986e-430c-b2dc-8d2dc1093d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:43.510862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:43.511819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 81/176] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:43.518389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451dd17-3629-421d-94ed-f109f96a5c31 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.519719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451dd17-3629-421d-94ed-f109f96a5c31 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.519719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451dd17-3629-421d-94ed-f109f96a5c31 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.519719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 82/177] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:43.519719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a107e-8bdd-46d3-83b9-6f9d913df0e8 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.519719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a107e-8bdd-46d3-83b9-6f9d913df0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.519719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a107e-8bdd-46d3-83b9-6f9d913df0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.533283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-479a107e-8bdd-46d3-83b9-6f9d913df0e8 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:43.534507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-479a107e-8bdd-46d3-83b9-6f9d913df0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:43.599587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 96/178] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:43.600066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 83/179] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:43.600419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.602790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf24351-5bc6-4caf-a4a4-c776a274278f None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.603077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf24351-5bc6-4caf-a4a4-c776a274278f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.603352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf24351-5bc6-4caf-a4a4-c776a274278f None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.608118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 84/180] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:43.608118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf24351-5bc6-4caf-a4a4-c776a274278f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.635720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.703302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a18e-b469-4582-8698-0c7d70507382 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:43.707748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf24351-5bc6-4caf-a4a4-c776a274278f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:43.725110 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.737407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46f60c-6af5-450a-add6-fe390a6823de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:43.738095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f60c-6af5-450a-add6-fe390a6823de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.738372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f60c-6af5-450a-add6-fe390a6823de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.738643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f60c-6af5-450a-add6-fe390a6823de None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.739380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f60c-6af5-450a-add6-fe390a6823de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:43.739681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f60c-6af5-450a-add6-fe390a6823de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:43.741043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f60c-6af5-450a-add6-fe390a6823de None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:43.741480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:43.742151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.742439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.742712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.743460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:43.743764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:43.745133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:43.749534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 97/181] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:43.750702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1049-328e-4d63-b164-1ecd927039c4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.750980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1049-328e-4d63-b164-1ecd927039c4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.751256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1049-328e-4d63-b164-1ecd927039c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.754571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 85/182] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:43.755548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.769014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c43f1049-328e-4d63-b164-1ecd927039c4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:43.770217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c43f1049-328e-4d63-b164-1ecd927039c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:43.835162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 98/183] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:43.836637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86ddc-eadd-45d6-bee0-6ad0dbfe582e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.836934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86ddc-eadd-45d6-bee0-6ad0dbfe582e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.837213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86ddc-eadd-45d6-bee0-6ad0dbfe582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.853004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-84b86ddc-eadd-45d6-bee0-6ad0dbfe582e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:43.854145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-84b86ddc-eadd-45d6-bee0-6ad0dbfe582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:43.856340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff75a-bc70-4ed9-8d85-947628dce4ba None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:43.871855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.890648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:43.891506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:43.891788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:43.892064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] PATH_INFO: `/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:43.893241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] RBAC: Authorizing `identity:get_project(project_id=16d8dab7ef7e49aa8404ced10f6a464f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:43.894725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:43.896422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 86/184] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/projects/16d8dab7ef7e49aa8404ced10f6a464f => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:43.901045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.925680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 99/185] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:43.937601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b86ddc-eadd-45d6-bee0-6ad0dbfe582e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:43.948423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.997757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65addc19-3810-4e7a-b839-2dd0961dc886 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.031225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.032028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.032313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.032593 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.034546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b86ddc-eadd-45d6-bee0-6ad0dbfe582e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.042534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:44.051099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:44.051975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:44.052766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 87/186] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:44.053413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.071213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.072076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.072352 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.072629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] PATH_INFO: `/v3/users/902653d053d145c0a81595daf27e2533` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.073842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] RBAC: Authorizing `identity:get_user(user_id=902653d053d145c0a81595daf27e2533)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.075286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.076881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 100/187] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:43 2022] GET /identity/v3/users/902653d053d145c0a81595daf27e2533 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:44.077674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.101916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.150901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2bd88-87f9-4258-8626-d00e5ce7358c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.160746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.175962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c497bf5-0984-449a-ab75-7bff455cc6e3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.185781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.186680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.186964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.187267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] PATH_INFO: `/v3/users/f8ee025614b44253bbfd0a5afa749bfb` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.202097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] RBAC: Authorizing `identity:get_user(user_id=f8ee025614b44253bbfd0a5afa749bfb)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.203549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.205233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 88/188] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/users/f8ee025614b44253bbfd0a5afa749bfb => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:44.206014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.208751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.209762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.210043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.210316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.221487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:44.228961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:44.230085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 101/189] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:44.231007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.306844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f97df8-7a19-4c7e-9f44-9e379b072c4b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.312389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.330731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdb340-422e-4173-81e1-1594903c8e2d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.341736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.342389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.342673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.343448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.344283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=16d8dab7ef7e49aa8404ced10f6a464f, user.id=902653d053d145c0a81595daf27e2533) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:44.344593 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.346065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.353641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 89/190] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/role_assignments?user.id=902653d053d145c0a81595daf27e2533&scope.project.id=16d8dab7ef7e49aa8404ced10f6a464f&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:44.353641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.367766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.369226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.369542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.369827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.371603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.373781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.380412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 102/191] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:44.380412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.396506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.486207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057597f-00f4-4458-b432-5cfbf7ed79d4 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.498060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf744f-3a05-4b2f-a2e4-482297ee1656 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.531784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.532817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.533304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.533861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.534820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:44.535307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.536863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.538965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.539618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.539902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.540186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.546959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 90/192] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:44.552272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.563971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.614671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.616137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.645720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.654650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a88046-50d3-46ba-a92b-ce39e2befa3d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.687864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.688506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.688790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.689067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.713435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 103/193] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:44.716937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.756159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.757574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.765310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.813742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751a058-52d8-4653-9849-869f05c77005 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.846616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.847839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.848627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.848988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.849308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.850103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:44.850554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.851889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.856528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 91/194] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:44.857313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.860791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 104/195] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:44.861793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:44.958536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d026936-8d76-4864-b06f-f92d64c8caea None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.959089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073cd5-efe3-4d12-8850-0bf42fb02640 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:44.971731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:44.991967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.992521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:44.992636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.992890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.993161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.993380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:44.993757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:44.993922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.994027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] PATH_INFO: `/v3/users/f8ee025614b44253bbfd0a5afa749bfb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:44.995191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] RBAC: Authorizing `identity:get_user(user_id=f8ee025614b44253bbfd0a5afa749bfb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:44.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.996600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:44.998245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 105/196] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/users/f8ee025614b44253bbfd0a5afa749bfb => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:44.999480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.016398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 92/197] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:05:44 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:45.017000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.073766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:45.127690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f616edb-65e6-4fb8-b38b-e135807bc04f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.134271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f61d9-28bd-462e-8d15-e459a8dae1ef None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.167460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.168365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.168651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.168930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.170268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.171731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.173433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 106/198] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:44 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:45.174214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.183673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.184538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.185330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.185330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.187088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.188335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.190260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 93/199] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:45.191094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.234404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:45.303990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5f36c-3b2b-4562-9c42-61412ef8dd30 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.314541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da65cf-4453-4d00-8579-3a660d123375 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.334976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:45.351848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.354441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.354441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.354441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] PATH_INFO: `/v3/users/090e9c670424405286a2416501f403dd` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.358977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] RBAC: Authorizing `identity:get_user(user_id=090e9c670424405286a2416501f403dd)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.358977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.359250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.359823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 107/200] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/users/090e9c670424405286a2416501f403dd => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:45.359927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.361025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.361129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.361201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.436106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.438227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.506003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3638885-5aeb-4a41-bb90-25b0d8658668 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.528406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:45.543837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 94/201] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:45.544802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.555721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.556672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.557282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.557782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.558826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] RBAC: Adding query filter params (role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=902653d053d145c0a81595daf27e2533) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:45.559350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.561212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.563835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:45.569422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 108/202] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/role_assignments?user.id=902653d053d145c0a81595daf27e2533&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:45.570740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.695847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076067-2c2f-4963-a428-e792dcde6b39 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.739235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.740003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.740388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.740667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.741530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=f8ee025614b44253bbfd0a5afa749bfb) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:45.741850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.743311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.744522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4c1e1-2c99-4df0-a172-0b1fd83846c5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.750065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 95/203] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/role_assignments?user.id=f8ee025614b44253bbfd0a5afa749bfb&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:45.750975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:45.802858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.803525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.803806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.804082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.849931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:45.890653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61ea9-f324-43cb-a490-1f01f93a1f75 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:45.904314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:45.942822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.944333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.964199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:45.965084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:45.965364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:45.965666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:45.968208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:45.969730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:45.971531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 96/204] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:45.978289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:46.107601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 109/205] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:46.114699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:46.125368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147368a7-f12b-40d5-a4df-c194f3d991d5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:46.177926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:46.178586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:46.178871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:46.179145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:46.180148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] RBAC: Adding query filter params (role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=f8ee025614b44253bbfd0a5afa749bfb) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:46.180465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:46.181944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:46.195713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 97/206] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:45 2022] GET /identity/v3/role_assignments?user.id=f8ee025614b44253bbfd0a5afa749bfb&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:46.209546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:46.241861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d97a-ad14-4278-823a-d8aa4f2b205b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:46.284844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b281e1c-8507-4dd4-9323-55733664b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:46.285742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b281e1c-8507-4dd4-9323-55733664b51c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:46.286025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b281e1c-8507-4dd4-9323-55733664b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:46.286299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b281e1c-8507-4dd4-9323-55733664b51c None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:46.287502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b281e1c-8507-4dd4-9323-55733664b51c None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:46.288958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b281e1c-8507-4dd4-9323-55733664b51c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:46.290857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 110/207] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:46 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:46.296918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:46.323649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:46.432894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753528f-dc0b-4893-8901-e1008d21fe8d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:46.482229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614100db-cc3d-45df-a914-71217759d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:46.482897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614100db-cc3d-45df-a914-71217759d55d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:46.483182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614100db-cc3d-45df-a914-71217759d55d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:46.483518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614100db-cc3d-45df-a914-71217759d55d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:46.484368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614100db-cc3d-45df-a914-71217759d55d None admin] RBAC: Adding query filter params (role.id=e2fe0be6ceca48a8b32415b51c1cd36b, scope.project.id=c55d54e19f7c488c94db31aee114ae9f, user.id=090e9c670424405286a2416501f403dd) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:46.484683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614100db-cc3d-45df-a914-71217759d55d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:46.486190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614100db-cc3d-45df-a914-71217759d55d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:46.492730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 98/208] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:46 2022] GET /identity/v3/role_assignments?user.id=090e9c670424405286a2416501f403dd&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=e2fe0be6ceca48a8b32415b51c1cd36b => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:47.401438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385f41-9a01-401c-a6db-3a952a0f082a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.402343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385f41-9a01-401c-a6db-3a952a0f082a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.402780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385f41-9a01-401c-a6db-3a952a0f082a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.404546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 111/209] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:47.410854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae687-2c1f-4327-a29a-3655206e95a0 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.411418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6afd2-6a42-4c20-907d-f20e2d7f5399 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.411708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6afd2-6a42-4c20-907d-f20e2d7f5399 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.411989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6afd2-6a42-4c20-907d-f20e2d7f5399 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.412317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae687-2c1f-4327-a29a-3655206e95a0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.412799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae687-2c1f-4327-a29a-3655206e95a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.413392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 112/210] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:47.418066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2cb9d-d2da-4bfe-8d75-2e53fa8be6cb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.418355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2cb9d-d2da-4bfe-8d75-2e53fa8be6cb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.418637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2cb9d-d2da-4bfe-8d75-2e53fa8be6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.432143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-938ae687-2c1f-4327-a29a-3655206e95a0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:47.433750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-938ae687-2c1f-4327-a29a-3655206e95a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:47.440528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-33b2cb9d-d2da-4bfe-8d75-2e53fa8be6cb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:47.442171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-33b2cb9d-d2da-4bfe-8d75-2e53fa8be6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:47.507334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 99/211] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:47.523623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 113/212] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:47.532606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae687-2c1f-4327-a29a-3655206e95a0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:47.541430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:47.553757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2cb9d-d2da-4bfe-8d75-2e53fa8be6cb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:47.637698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:47.658812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae687-2c1f-4327-a29a-3655206e95a0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:47.666880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2cb9d-d2da-4bfe-8d75-2e53fa8be6cb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:47.693302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:47.694102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.694380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.694650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.705570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:47.706657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:47.707671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.708192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.708660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.710415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:47.712071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:47.713378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:47.714728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:47.719445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 100/213] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:47.720357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 114/214] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:47.723747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:47.723862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:47.794707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:47.832379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a3faf-484d-41cf-8dcd-0ca19de0d1c3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:47.835957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf6387-fa22-440b-b796-3404a9258eaa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:47.868901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:47.869600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.869889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.870169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.871195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:47.871510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:47.873093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:47.875046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:47.876061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:47.876540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:47.877008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:47.877966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:47.879679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:47.882407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 101/215] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:47.887761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:47.906056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 115/216] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:05:47 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:48.000611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb402d0-568d-4230-9881-e1844794a537 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:48.030518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:48.038885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c02b6-7ed8-404a-93a9-15867e0d8b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:48.039792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c02b6-7ed8-404a-93a9-15867e0d8b7d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.040166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c02b6-7ed8-404a-93a9-15867e0d8b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.040331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c02b6-7ed8-404a-93a9-15867e0d8b7d None admin] PATH_INFO: `/v3/users/27efb388a22846a68535736cfba546be` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.055498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c02b6-7ed8-404a-93a9-15867e0d8b7d None admin] RBAC: Authorizing `identity:get_user(user_id=27efb388a22846a68535736cfba546be)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:48.056992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c02b6-7ed8-404a-93a9-15867e0d8b7d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:48.058781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 102/217] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:47 2022] GET /identity/v3/users/27efb388a22846a68535736cfba546be => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:48.064893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:48.067774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:48.105714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc84588-fbe2-4186-a00f-a92ff9302465 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.106064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc84588-fbe2-4186-a00f-a92ff9302465 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.106264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc84588-fbe2-4186-a00f-a92ff9302465 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.107770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 103/218] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:48.112583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855ffe4-aceb-4f5d-9946-2d04f4ccd89a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.112867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855ffe4-aceb-4f5d-9946-2d04f4ccd89a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.113138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855ffe4-aceb-4f5d-9946-2d04f4ccd89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.131193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2855ffe4-aceb-4f5d-9946-2d04f4ccd89a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:48.132372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2855ffe4-aceb-4f5d-9946-2d04f4ccd89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:48.201671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b066-df62-4c43-898c-b8b34d17649f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:48.220524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 104/219] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:48.243214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855ffe4-aceb-4f5d-9946-2d04f4ccd89a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:48.246961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:48.247559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.249785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.250286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.333160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:48.334688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:48.336805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:48.373770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855ffe4-aceb-4f5d-9946-2d04f4ccd89a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:48.392957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:48.431178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:48.432679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.434133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.434623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.453536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:48.464143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:48.465202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:48.466199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:48.474134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 105/220] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:48.483169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:48.511667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 116/221] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:48.520913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:48.639988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10edec-c47d-429a-9e08-30d89d4f3c1f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:48.641964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:48.644344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6368-6f10-41d6-98fd-84dc8d8ebe60 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:48.684523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:48.686105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.686589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.687005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.688355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:48.689980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:48.692288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 117/222] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:48 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:48.698331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:48.727224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32840259-1acd-4089-a163-4cfd0a0a9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:48.727804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32840259-1acd-4089-a163-4cfd0a0a9029 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.728087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32840259-1acd-4089-a163-4cfd0a0a9029 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.728362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32840259-1acd-4089-a163-4cfd0a0a9029 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.729128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32840259-1acd-4089-a163-4cfd0a0a9029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:48.729439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32840259-1acd-4089-a163-4cfd0a0a9029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:48.730865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32840259-1acd-4089-a163-4cfd0a0a9029 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:48.750883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 106/223] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:48.755264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bddfc7-0321-45c8-ad20-77b6ff00da02 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.755264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bddfc7-0321-45c8-ad20-77b6ff00da02 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.755264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bddfc7-0321-45c8-ad20-77b6ff00da02 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.755264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 107/224] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:48.756712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bddfc7-0321-45c8-ad20-77b6ff00da02 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:48.812300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:48.833252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a834ee5-492e-4edb-baf9-488769614473 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:48.870382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964b6f0-a180-45a6-8b7d-8be5713e8ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:48.871043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964b6f0-a180-45a6-8b7d-8be5713e8ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.871404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964b6f0-a180-45a6-8b7d-8be5713e8ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.871613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964b6f0-a180-45a6-8b7d-8be5713e8ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.872435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964b6f0-a180-45a6-8b7d-8be5713e8ba4 None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=27efb388a22846a68535736cfba546be) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:48.872748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964b6f0-a180-45a6-8b7d-8be5713e8ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:48.874253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964b6f0-a180-45a6-8b7d-8be5713e8ba4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:48.880207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 118/225] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:48 2022] GET /identity/v3/role_assignments?user.id=27efb388a22846a68535736cfba546be&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:48.881423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf786-d3e3-4f94-a68c-754789cdefdb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.881737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf786-d3e3-4f94-a68c-754789cdefdb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.882023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf786-d3e3-4f94-a68c-754789cdefdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.891902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bddfc7-0321-45c8-ad20-77b6ff00da02 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:48.899900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d7acf786-d3e3-4f94-a68c-754789cdefdb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:48.901131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d7acf786-d3e3-4f94-a68c-754789cdefdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:48.931878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:48.935745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:48.937275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:48.937933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:48.938724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] PATH_INFO: `/v3/users/f8ee025614b44253bbfd0a5afa749bfb` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:48.940713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ee025614b44253bbfd0a5afa749bfb)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:48.942598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:48.944815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 108/226] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:48 2022] GET /identity/v3/users/f8ee025614b44253bbfd0a5afa749bfb => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:48.950434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:48.995467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 119/227] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:49.032028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acf786-d3e3-4f94-a68c-754789cdefdb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:49.068060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4a439-c395-47a0-80c5-748698234ff6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:49.078930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:49.105864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:49.107100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:49.107683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:49.108147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:49.109602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:49.111211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:49.113155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 109/228] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:48 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:49.119015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:49.222864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38250-b9ee-4adb-b375-43e124c14fd3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:49.258678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:49.259829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:49.260376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:49.260828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c/users/f8ee025614b44253bbfd0a5afa749bfb/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:49.263184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] RBAC: Authorizing `identity:create_grant(project_id=6d013c02af3f48b59b1127676002583c, user_id=f8ee025614b44253bbfd0a5afa749bfb, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:49.265354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:49.276899 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acf786-d3e3-4f94-a68c-754789cdefdb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:49.288848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 110/229] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:49 2022] PUT /identity/v3/projects/6d013c02af3f48b59b1127676002583c/users/f8ee025614b44253bbfd0a5afa749bfb/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:49.334931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:49.341536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:49.342023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:49.342473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:49.368970 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:49.377996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:49.378920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:49.379711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 120/230] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:05:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:49.385283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:49.449330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:49.532671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac36b0-b078-40c7-b5ef-44ca5b6169cb None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:49.574230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:49.574917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:49.575206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:49.575484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:49.576262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:49.576572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:49.578643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:49.596092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 111/231] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:05:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:49.600005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:49.638598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:49.741558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af42e5-ebf7-42a7-a9e4-93c6b900ce4f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:49.787250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:49.788106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:49.788394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:49.788674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] PATH_INFO: `/v3/users/f8ee025614b44253bbfd0a5afa749bfb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:49.789938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ee025614b44253bbfd0a5afa749bfb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:49.791417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:49.793240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 121/232] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:49 2022] GET /identity/v3/users/f8ee025614b44253bbfd0a5afa749bfb => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:49.802547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:49.939569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:49.949356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64cc16-e0fb-4f4b-8a0d-38b365832f3c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:49.994091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8eba5-3d43-49e1-8bce-443fe63121f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:49.994965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8eba5-3d43-49e1-8bce-443fe63121f1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:49.995249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8eba5-3d43-49e1-8bce-443fe63121f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:49.995527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8eba5-3d43-49e1-8bce-443fe63121f1 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:49.998183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8eba5-3d43-49e1-8bce-443fe63121f1 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:50.000405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8eba5-3d43-49e1-8bce-443fe63121f1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:50.002672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 112/233] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:49 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:50.008136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:50.160644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:50.169268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d2cf-59e3-4e76-8be2-477f2c5c6923 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:50.215523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f8e81-8f5d-446e-bdcb-273b39c76ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:50.216418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8e81-8f5d-446e-bdcb-273b39c76ba2 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:50.216700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8e81-8f5d-446e-bdcb-273b39c76ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:50.216973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8e81-8f5d-446e-bdcb-273b39c76ba2 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c/users/f8ee025614b44253bbfd0a5afa749bfb/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:50.223253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8e81-8f5d-446e-bdcb-273b39c76ba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d013c02af3f48b59b1127676002583c, user_id=f8ee025614b44253bbfd0a5afa749bfb, role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:50.224706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8e81-8f5d-446e-bdcb-273b39c76ba2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:50.256756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 122/234] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:50 2022] PUT /identity/v3/projects/6d013c02af3f48b59b1127676002583c/users/f8ee025614b44253bbfd0a5afa749bfb/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:50.642480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceeac4-facb-4f6a-b5d6-bd614ac67c54 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:50.643015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceeac4-facb-4f6a-b5d6-bd614ac67c54 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:50.643015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceeac4-facb-4f6a-b5d6-bd614ac67c54 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:50.644551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 113/235] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:50.650040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b94a49-74f2-4ef3-b9c8-050ff0370eab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:50.650857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b94a49-74f2-4ef3-b9c8-050ff0370eab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:50.651353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b94a49-74f2-4ef3-b9c8-050ff0370eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:50.669065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-34b94a49-74f2-4ef3-b9c8-050ff0370eab None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:50.670610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-34b94a49-74f2-4ef3-b9c8-050ff0370eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:50.773183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 123/236] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:50.800094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab58f8-99f1-4252-bc71-520c358b6e95 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:50.800437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab58f8-99f1-4252-bc71-520c358b6e95 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:50.800660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab58f8-99f1-4252-bc71-520c358b6e95 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:50.803467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 114/237] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:50.808343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1654-f923-4470-ba08-aa474745ae9f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:50.808632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1654-f923-4470-ba08-aa474745ae9f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:50.808911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1654-f923-4470-ba08-aa474745ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:50.818823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab58f8-99f1-4252-bc71-520c358b6e95 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:50.830577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8b7a1654-f923-4470-ba08-aa474745ae9f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:50.831760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8b7a1654-f923-4470-ba08-aa474745ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:50.950513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 124/238] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:50.977738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1654-f923-4470-ba08-aa474745ae9f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:50.989116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab58f8-99f1-4252-bc71-520c358b6e95 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:51.054837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.055881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.056310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.056758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.058208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:51.059816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:51.067124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 115/239] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:51.069184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:51.119624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:51.160701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1654-f923-4470-ba08-aa474745ae9f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.199812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.201538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.202094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.203083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.215632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:51.224326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:51.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:51.226338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:51.228843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 125/240] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:51.234367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:51.259927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec926-8dc4-40b0-aecc-ebbeb864260b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.297291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3b00-d6e3-4e64-aee9-c2924cc424e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.298046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3b00-d6e3-4e64-aee9-c2924cc424e9 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.298328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3b00-d6e3-4e64-aee9-c2924cc424e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.298653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3b00-d6e3-4e64-aee9-c2924cc424e9 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.299377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3b00-d6e3-4e64-aee9-c2924cc424e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:51.300822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3b00-d6e3-4e64-aee9-c2924cc424e9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:51.326358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 116/241] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:05:51 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:51.346751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fddfd-2a72-474a-9441-850d5f216b58 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.347082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fddfd-2a72-474a-9441-850d5f216b58 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.347406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fddfd-2a72-474a-9441-850d5f216b58 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.349010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 117/242] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:51.357812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ddcd-39e5-4441-b5b5-1ffa1c72d789 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.358141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ddcd-39e5-4441-b5b5-1ffa1c72d789 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.358975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ddcd-39e5-4441-b5b5-1ffa1c72d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.380320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7021ddcd-39e5-4441-b5b5-1ffa1c72d789 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:51.381820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7021ddcd-39e5-4441-b5b5-1ffa1c72d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:51.407451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:51.468168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 118/243] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:51.478304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03775375-6f2b-47ba-acb1-c7d54bab36d5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.492374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ddcd-39e5-4441-b5b5-1ffa1c72d789 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:51.513875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:51.543262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.544240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.544240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.544514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.545358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:51.546307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:51.547850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:51.564892 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 126/244] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:51.570378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:51.604083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ddcd-39e5-4441-b5b5-1ffa1c72d789 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.645758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.646640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.647355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.648713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.663308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:51.674923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:51.676067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:51.677040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:51.681599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 119/245] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:51.687187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:51.688105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7215-0db2-49da-aa20-b60fae5432c0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.742913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.744416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.745072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.745455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] PATH_INFO: `/v3/users/d09f7b4c18ac4afca6c16cd27b345af7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.748194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:51.767375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] RBAC: Authorizing `identity:get_user(user_id=d09f7b4c18ac4afca6c16cd27b345af7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:51.769511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:51.772268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 127/246] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:51 2022] GET /identity/v3/users/d09f7b4c18ac4afca6c16cd27b345af7 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:51.778464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:51.782403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:51.816137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d57c1-aa9e-4755-87e1-2c4c0a767716 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.854984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64da7fe-ab2f-4c6c-b800-5ea3864a791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.854984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64da7fe-ab2f-4c6c-b800-5ea3864a791b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.854984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64da7fe-ab2f-4c6c-b800-5ea3864a791b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.854984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64da7fe-ab2f-4c6c-b800-5ea3864a791b None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.855725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64da7fe-ab2f-4c6c-b800-5ea3864a791b None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:51.856030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64da7fe-ab2f-4c6c-b800-5ea3864a791b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:51.857428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64da7fe-ab2f-4c6c-b800-5ea3864a791b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:51.867539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 120/247] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:51.868862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ff00-9e72-4f1d-a3ee-bc7f68c19a3f None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.869159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ff00-9e72-4f1d-a3ee-bc7f68c19a3f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.869445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ff00-9e72-4f1d-a3ee-bc7f68c19a3f None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.870728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 121/248] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:51.876643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954887fd-cdba-4aa2-9f8d-7386afff7f99 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.876928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954887fd-cdba-4aa2-9f8d-7386afff7f99 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.877478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954887fd-cdba-4aa2-9f8d-7386afff7f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.894933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-954887fd-cdba-4aa2-9f8d-7386afff7f99 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:51.896186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-954887fd-cdba-4aa2-9f8d-7386afff7f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:51.911589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d1c96-8854-45fc-b0f0-73e4ee901c7f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:51.955728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:51.957105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:51.957700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:51.958213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:51.975334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 122/249] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:51.976280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954887fd-cdba-4aa2-9f8d-7386afff7f99 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.037542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:52.049729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:52.051501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:52.056978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:52.094407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954887fd-cdba-4aa2-9f8d-7386afff7f99 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:52.141768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:52.142813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.143100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.143376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] PATH_INFO: `/v3/users/27efb388a22846a68535736cfba546be` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.145248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] RBAC: Authorizing `identity:get_user(user_id=27efb388a22846a68535736cfba546be)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:52.147387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:52.149147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 123/250] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:51 2022] GET /identity/v3/users/27efb388a22846a68535736cfba546be => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:52.149769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.173852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 128/251] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:05:52.175066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.266918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051864-5122-43bb-8039-b575158ce590 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:52.306437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:52.307469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.307948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.308414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.317089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:52.321162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:52.330665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:52.331831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:05:52.332625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:52.333777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 124/252] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:05:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:52.337344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.379200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:52.403621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c011cc2-3700-4fc3-b83c-52788d2246c5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:52.454202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2762-4acc-4e76-a970-eb73621bf15c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:52.472796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:52.473821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.474105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.474381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.478502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:52.480162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:52.482139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 129/253] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:52 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:52.482912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.513633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:52.515062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.515358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.515638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.517975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:52.520572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:52.522778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 125/254] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:52 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:52.524223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.613189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92b54f-a03b-4312-b3be-6628e286d0d9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:52.654010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:52.656094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.656582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.657272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.659288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:52.660003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:52.662226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:52.679830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 130/255] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:52.680512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:52.683344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.734802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:52.756152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288651e-cbe2-4dcf-bdf8-a9b7395f37fe None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:52.798166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:52.799058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.799342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.799622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c/users/27efb388a22846a68535736cfba546be/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.802094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] RBAC: Authorizing `identity:create_grant(project_id=6d013c02af3f48b59b1127676002583c, user_id=27efb388a22846a68535736cfba546be, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:52.803921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:52.821604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 126/256] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:52 2022] PUT /identity/v3/projects/6d013c02af3f48b59b1127676002583c/users/27efb388a22846a68535736cfba546be/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:52.822873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:52.830389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93919ca-8a55-46de-8451-bdb4cc776bf3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:52.882232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828b4b-a7cc-4be7-83a0-aded103a589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:52.883288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828b4b-a7cc-4be7-83a0-aded103a589f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.883928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828b4b-a7cc-4be7-83a0-aded103a589f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.884413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828b4b-a7cc-4be7-83a0-aded103a589f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.885505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828b4b-a7cc-4be7-83a0-aded103a589f None admin] RBAC: Adding query filter params (role.id=e2fe0be6ceca48a8b32415b51c1cd36b, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=d09f7b4c18ac4afca6c16cd27b345af7) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:52.886057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828b4b-a7cc-4be7-83a0-aded103a589f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:52.887820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828b4b-a7cc-4be7-83a0-aded103a589f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:52.903541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 131/257] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:52 2022] GET /identity/v3/role_assignments?user.id=d09f7b4c18ac4afca6c16cd27b345af7&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=e2fe0be6ceca48a8b32415b51c1cd36b => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:52.905342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea5466-8927-45ca-b794-818bea642302 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.905877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea5466-8927-45ca-b794-818bea642302 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.906345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea5466-8927-45ca-b794-818bea642302 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.907897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 132/258] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:52.913651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9979-881d-4953-830f-765f1d9f66f6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:52.914199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9979-881d-4953-830f-765f1d9f66f6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:52.914672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9979-881d-4953-830f-765f1d9f66f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:52.950355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bbaf9979-881d-4953-830f-765f1d9f66f6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:52.952113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bbaf9979-881d-4953-830f-765f1d9f66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:52.980396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96c98c-06e6-4bdc-875e-a03c2b84d3fb None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:53.028152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:53.054629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:53.055706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:53.056114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:53.062530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] PATH_INFO: `/v3/users/f8ee025614b44253bbfd0a5afa749bfb` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:53.064213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] RBAC: Authorizing `identity:get_user(user_id=f8ee025614b44253bbfd0a5afa749bfb)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:53.065863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:53.069585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 127/259] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:52 2022] GET /identity/v3/users/f8ee025614b44253bbfd0a5afa749bfb => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:53.075138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:53.128090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 133/260] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:53.176951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9979-881d-4953-830f-765f1d9f66f6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:53.205507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:53.288318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaacef4-6860-4383-8b27-df0998306a3a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:53.339723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9979-881d-4953-830f-765f1d9f66f6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:53.386166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:53.387190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:53.387679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:53.388157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:53.396902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:53.405573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:53.405573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:53.405573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:53.416550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:53.425375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:53.426301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:05:53.427148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:53.439050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 134/261] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:05:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:53.446422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:53.487328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:53.507836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:53.509325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:53.627998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:53.673738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78405-d7e6-4350-9c48-2990c36c7f9a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:53.739211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:53.739968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:53.740249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:53.740439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:53.741233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:53.741566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:53.743003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:53.758095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 128/263] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:05:53.758590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 135/263] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:05:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:53.763091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:53.768011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:53.878322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668ff4-f984-40a3-bc1d-73ac0af38b87 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:53.919468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:53.920343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:53.920662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:53.920943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:53.924777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:53.926263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:53.927989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 136/264] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:53 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:53.934570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:53.942970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:53.948070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:53.956321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed2be7-b88d-4f83-afea-44089479979c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:53.995689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:53.996472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:53.996754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:53.997057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] PATH_INFO: `/v3/users/f8ee025614b44253bbfd0a5afa749bfb` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:53.999379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] RBAC: Authorizing `identity:get_user(user_id=f8ee025614b44253bbfd0a5afa749bfb)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:54.000310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:54.005477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 129/265] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:53 2022] GET /identity/v3/users/f8ee025614b44253bbfd0a5afa749bfb => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:54.007599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:54.101890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220493f2-2175-457c-9653-4d20fb9b6f4f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:54.155544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad902d8-7402-494c-8e81-7956ce6ed3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:54.156570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad902d8-7402-494c-8e81-7956ce6ed3ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.157134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad902d8-7402-494c-8e81-7956ce6ed3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.157681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad902d8-7402-494c-8e81-7956ce6ed3ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.158759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad902d8-7402-494c-8e81-7956ce6ed3ef None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=f8ee025614b44253bbfd0a5afa749bfb) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:54.159264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad902d8-7402-494c-8e81-7956ce6ed3ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:54.160890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad902d8-7402-494c-8e81-7956ce6ed3ef None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:54.173494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 137/266] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:53 2022] GET /identity/v3/role_assignments?user.id=f8ee025614b44253bbfd0a5afa749bfb&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:54.229601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a943701-ea0d-4530-8834-9b94e43a7e8d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:54.277308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87915e8-03a1-4d64-ae96-ce94fcff2910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:54.282482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87915e8-03a1-4d64-ae96-ce94fcff2910 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.282765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87915e8-03a1-4d64-ae96-ce94fcff2910 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.283043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87915e8-03a1-4d64-ae96-ce94fcff2910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.322981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:54.387984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87915e8-03a1-4d64-ae96-ce94fcff2910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:54.389540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87915e8-03a1-4d64-ae96-ce94fcff2910 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:54.416362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b908fb3-1052-4dd9-a36c-463f7df18af2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.416967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b908fb3-1052-4dd9-a36c-463f7df18af2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.417434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b908fb3-1052-4dd9-a36c-463f7df18af2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.419115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 138/267] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:54.424614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778a03-26ed-4037-bb62-069100d22d75 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.425145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778a03-26ed-4037-bb62-069100d22d75 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.425672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778a03-26ed-4037-bb62-069100d22d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.476273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b9778a03-26ed-4037-bb62-069100d22d75 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:54.479255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b9778a03-26ed-4037-bb62-069100d22d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:54.590506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:54.599229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 130/268] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:54.600696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa64ed6-d14f-41db-bcc8-1d8493157b95 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.600993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa64ed6-d14f-41db-bcc8-1d8493157b95 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.601275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa64ed6-d14f-41db-bcc8-1d8493157b95 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.601619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 139/269] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:54.605490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9778a03-26ed-4037-bb62-069100d22d75 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:54.606678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 131/270] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:54.608720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2884b5-fc3a-4867-834e-bf1bd59308d0 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.609085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2884b5-fc3a-4867-834e-bf1bd59308d0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.609436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2884b5-fc3a-4867-834e-bf1bd59308d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.631065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4d2884b5-fc3a-4867-834e-bf1bd59308d0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:54.632777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4d2884b5-fc3a-4867-834e-bf1bd59308d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:54.725454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:54.739335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 132/271] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:54.740497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2884b5-fc3a-4867-834e-bf1bd59308d0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:54.747900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9778a03-26ed-4037-bb62-069100d22d75 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:54.785825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:54.786718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.787003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.787280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.789047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:54.790803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:54.798739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 140/272] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:54 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:54.798739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:54.857138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2884b5-fc3a-4867-834e-bf1bd59308d0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:54.883100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:54.899189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:54.899988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.900270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.900546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.912641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:54.920421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:54.921932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:54.922750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 133/273] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:54.923415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:54.930681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded3b8-2410-4a5e-9291-524b03084964 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:54.984296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:54.986403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:54.987172 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:54.987657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:54.989714 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:54.991465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:54.992420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:54.995781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 141/274] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:54.998308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:55.046145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7702380-0c7e-446a-b2d3-b841cf64da18 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:55.081807 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:55.082539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.082747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.083016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.083849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] RBAC: Adding query filter params (role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=f8ee025614b44253bbfd0a5afa749bfb) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:55.084166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:55.085674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:55.098109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 134/275] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:54 2022] GET /identity/v3/role_assignments?user.id=f8ee025614b44253bbfd0a5afa749bfb&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:55.098109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:55.125183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a4a89-b70a-4fd5-a326-1be572f8d9d5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:55.164306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:55.165405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.165942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.166423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.167426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:55.167945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:55.169699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:55.172564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:55.180274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 142/276] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:55.194787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:55.219552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3601-9b03-4746-ab6c-9ea4c815a06e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:55.248848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:55.292153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:55.292839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.294477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.294477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.294477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:55.296404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:55.327947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 135/277] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:05:55 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:55.380484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bdc95-cdc1-48db-bdb6-5fdd504bc145 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:55.427247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c877-fc9c-4527-8da3-18354650822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:55.428563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c877-fc9c-4527-8da3-18354650822a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.429090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c877-fc9c-4527-8da3-18354650822a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.429608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c877-fc9c-4527-8da3-18354650822a None admin] PATH_INFO: `/v3/users/4fc29ca6ee1a4d869739fd55c216fcdc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.453694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c877-fc9c-4527-8da3-18354650822a None admin] RBAC: Authorizing `identity:get_user(user_id=4fc29ca6ee1a4d869739fd55c216fcdc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:55.455186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c877-fc9c-4527-8da3-18354650822a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:55.456976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 143/278] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:55 2022] GET /identity/v3/users/4fc29ca6ee1a4d869739fd55c216fcdc => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:55.463069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:55.580053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f30f2-babe-4d7b-bb4e-31cdb9eb90a8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:55.614312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb2fb4-20d7-4559-8466-7a0c95a6848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:55.615052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb2fb4-20d7-4559-8466-7a0c95a6848b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.615328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb2fb4-20d7-4559-8466-7a0c95a6848b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb2fb4-20d7-4559-8466-7a0c95a6848b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.616490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb2fb4-20d7-4559-8466-7a0c95a6848b None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, user.id=4fc29ca6ee1a4d869739fd55c216fcdc, scope.system=all) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:55.616799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb2fb4-20d7-4559-8466-7a0c95a6848b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:55.618267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb2fb4-20d7-4559-8466-7a0c95a6848b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:55.624467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 136/279] 10.222.0.47 () {56 vars in 1308 bytes} [Thu Jun 30 13:05:55 2022] GET /identity/v3/role_assignments?user.id=4fc29ca6ee1a4d869739fd55c216fcdc&scope.system=all&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:55.690635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de72e9-ac9a-4fdc-b88d-b562a5a8d57e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.690896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de72e9-ac9a-4fdc-b88d-b562a5a8d57e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.691181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de72e9-ac9a-4fdc-b88d-b562a5a8d57e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.692886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 144/280] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:55.698486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0f73b-05e1-4dd9-bdaa-ba9caefa7181 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.698775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0f73b-05e1-4dd9-bdaa-ba9caefa7181 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.699056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0f73b-05e1-4dd9-bdaa-ba9caefa7181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.720626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-1fd0f73b-05e1-4dd9-bdaa-ba9caefa7181 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:55.722336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1fd0f73b-05e1-4dd9-bdaa-ba9caefa7181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:55.755905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:55.790624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9ad0-ee7b-4944-8523-7b219dfa10ef None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.791146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9ad0-ee7b-4944-8523-7b219dfa10ef None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.791251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9ad0-ee7b-4944-8523-7b219dfa10ef None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.792746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 145/281] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:55.800503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313afc2-dbb2-4f0d-a7a1-680f80cd7101 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:55.800780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313afc2-dbb2-4f0d-a7a1-680f80cd7101 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:55.801056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313afc2-dbb2-4f0d-a7a1-680f80cd7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:55.805447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 137/282] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:55.829114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7313afc2-dbb2-4f0d-a7a1-680f80cd7101 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:55.830537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7313afc2-dbb2-4f0d-a7a1-680f80cd7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:55.831721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0f73b-05e1-4dd9-bdaa-ba9caefa7181 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:55.897273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:55.920320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 146/283] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:55.944970 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313afc2-dbb2-4f0d-a7a1-680f80cd7101 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:55.964962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0f73b-05e1-4dd9-bdaa-ba9caefa7181 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.017486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.017486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.017486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.017486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.025426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:56.033893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:56.034811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:56.035621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 138/284] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:56.041131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:56.071991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:56.097773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313afc2-dbb2-4f0d-a7a1-680f80cd7101 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.152518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebec14f-4e6b-4c9f-b554-0c6ebe697883 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.153318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.154470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.155538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.156022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.182529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:56.188315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.188993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.189278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.189587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.190345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:56.190658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:56.196370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:56.197910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:56.198790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:56.199585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:56.202462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 147/286] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:56.206989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 139/286] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:05:56.207108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:56.210257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:56.294355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:56.360146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7acdb-e49d-4578-a2f6-a55261663bc8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.405610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.406607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.406889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.407165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] PATH_INFO: `/v3/users/d09f7b4c18ac4afca6c16cd27b345af7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.413066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] RBAC: Authorizing `identity:get_user(user_id=d09f7b4c18ac4afca6c16cd27b345af7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:56.422647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:56.424668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 148/287] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:56 2022] GET /identity/v3/users/d09f7b4c18ac4afca6c16cd27b345af7 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:56.441555 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:56.455155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:56.459337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6abb81-8e7e-42a0-987c-d671acda62a4 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.500782 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.501475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.501770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.502051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.502803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:56.503114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:56.504487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:56.527426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 140/288] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:56.534054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:56.654392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed713d7-bce0-43ff-9bd8-4d6028078b56 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.695775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.696652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.696935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.697211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] PATH_INFO: `/v3/users/27efb388a22846a68535736cfba546be` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.706316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] RBAC: Authorizing `identity:get_user(user_id=27efb388a22846a68535736cfba546be)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:56.707618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4297-ff7f-4148-ac61-abb20abcdf1d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.707734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:56.709500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 141/289] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:56 2022] GET /identity/v3/users/27efb388a22846a68535736cfba546be => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:56.715148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:56.723877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:56.750608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.751464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.751751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.752025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.756681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:56.758168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:56.759207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:56.764119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 149/290] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:56 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:56.774205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:56.881629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d23d77-427a-493c-ba92-6421c8e1d65e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.935766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:56.937365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:56.937879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:56.938354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:56.957416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc171-09de-4c72-80c6-2608d457ea31 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:56.999183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:57.000091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:57.000376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:57.000653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c/users/d09f7b4c18ac4afca6c16cd27b345af7/roles/e2fe0be6ceca48a8b32415b51c1cd36b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:57.008548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] RBAC: Authorizing `identity:create_grant(project_id=6d013c02af3f48b59b1127676002583c, user_id=d09f7b4c18ac4afca6c16cd27b345af7, role_id=e2fe0be6ceca48a8b32415b51c1cd36b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:57.010083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:57.042413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 150/291] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:05:56 2022] PUT /identity/v3/projects/6d013c02af3f48b59b1127676002583c/users/d09f7b4c18ac4afca6c16cd27b345af7/roles/e2fe0be6ceca48a8b32415b51c1cd36b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:57.081810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:57.083950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:57.114895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:57.224464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 142/292] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:05:57.229706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:57.294557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:57.363372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ba41-1b1a-4855-bd53-3b502258d31c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:57.401486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21a2d5-7ab3-4e26-8d12-7cdb9c7fccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:57.402366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21a2d5-7ab3-4e26-8d12-7cdb9c7fccfa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:57.402653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21a2d5-7ab3-4e26-8d12-7cdb9c7fccfa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:57.402933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21a2d5-7ab3-4e26-8d12-7cdb9c7fccfa None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:57.404137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21a2d5-7ab3-4e26-8d12-7cdb9c7fccfa None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:57.405649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21a2d5-7ab3-4e26-8d12-7cdb9c7fccfa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:57.407368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 151/293] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:05:57 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:57.413322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:57.558262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b505-7e7d-4802-932a-ebc61f71a32a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:57.585890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:57.604667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a3c06-116d-45c3-93aa-170c42727880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:57.605784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a3c06-116d-45c3-93aa-170c42727880 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:57.606327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a3c06-116d-45c3-93aa-170c42727880 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:57.606936 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a3c06-116d-45c3-93aa-170c42727880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:57.607917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a3c06-116d-45c3-93aa-170c42727880 None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=27efb388a22846a68535736cfba546be) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:57.608931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a3c06-116d-45c3-93aa-170c42727880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:57.610562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a3c06-116d-45c3-93aa-170c42727880 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:57.621571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 143/294] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:05:57 2022] GET /identity/v3/role_assignments?user.id=27efb388a22846a68535736cfba546be&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:57.940477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde64f-9442-4111-8132-aa317be3cafb None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:57.940819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde64f-9442-4111-8132-aa317be3cafb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:57.940943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde64f-9442-4111-8132-aa317be3cafb None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:57.942587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 152/295] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:57.947997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5c09e-e204-4887-9020-e0c5221d796b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:57.948297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5c09e-e204-4887-9020-e0c5221d796b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:57.948581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5c09e-e204-4887-9020-e0c5221d796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:57.967925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e2e5c09e-e204-4887-9020-e0c5221d796b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:57.969143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e2e5c09e-e204-4887-9020-e0c5221d796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:57.973436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f5aab-f0a2-446c-ae9d-34e3258a7f13 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:57.973908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f5aab-f0a2-446c-ae9d-34e3258a7f13 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:57.974084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f5aab-f0a2-446c-ae9d-34e3258a7f13 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:57.975389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 153/296] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:05:57.980505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3337e3-0db0-42f5-a738-949c20cc95af None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:57.980803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3337e3-0db0-42f5-a738-949c20cc95af None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:57.981089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3337e3-0db0-42f5-a738-949c20cc95af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.007967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0b3337e3-0db0-42f5-a738-949c20cc95af None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:58.009897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0b3337e3-0db0-42f5-a738-949c20cc95af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:58.063892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 144/297] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:58.093426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5c09e-e204-4887-9020-e0c5221d796b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.112016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 154/298] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:05:58.136996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3337e3-0db0-42f5-a738-949c20cc95af None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.185060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:58.207467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5c09e-e204-4887-9020-e0c5221d796b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.221299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:58.244104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66887-73a3-4834-a874-905fe1375f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.244895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66887-73a3-4834-a874-905fe1375f07 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.245176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66887-73a3-4834-a874-905fe1375f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.245452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66887-73a3-4834-a874-905fe1375f07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.248337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3337e3-0db0-42f5-a738-949c20cc95af None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.255765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66887-73a3-4834-a874-905fe1375f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-f9f66887-73a3-4834-a874-905fe1375f07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:58.263423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:58.265039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:58.266005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 145/299] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:58.271191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead166c-1f94-4452-bf19-7c55a303efd9 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.271489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead166c-1f94-4452-bf19-7c55a303efd9 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.271773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead166c-1f94-4452-bf19-7c55a303efd9 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.273715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 146/300] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:58.277569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead166c-1f94-4452-bf19-7c55a303efd9 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.288121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1635941-3dd5-476b-90ad-5f870f1598fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.288912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1635941-3dd5-476b-90ad-5f870f1598fd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.289196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1635941-3dd5-476b-90ad-5f870f1598fd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.289708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1635941-3dd5-476b-90ad-5f870f1598fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.300096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1635941-3dd5-476b-90ad-5f870f1598fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b1635941-3dd5-476b-90ad-5f870f1598fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:58.307801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:58.308656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:05:58.309478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 155/301] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:05:58.310762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815873cd-90c4-4773-86ea-5c9c12190579 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.310762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815873cd-90c4-4773-86ea-5c9c12190579 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.310762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815873cd-90c4-4773-86ea-5c9c12190579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.329576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-815873cd-90c4-4773-86ea-5c9c12190579 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:58.330925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-815873cd-90c4-4773-86ea-5c9c12190579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:58.393082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead166c-1f94-4452-bf19-7c55a303efd9 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.404654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 156/302] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:58.405337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815873cd-90c4-4773-86ea-5c9c12190579 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.436029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:58.440813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.442227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.442227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.442424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.443092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:58.443403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:58.444785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:58.454601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 147/303] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:58.455237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.490230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:58.515473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815873cd-90c4-4773-86ea-5c9c12190579 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.550963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.551637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.551914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.552192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.552954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:58.553258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:58.554670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:58.564249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 157/304] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:58.564857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.569152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864f6c-d79d-4add-a628-253d60c24ba9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.604039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.604824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.605103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.605373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.606568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:58.608035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:58.609831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 148/305] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:58.614921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.661931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:58.671083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c58dbf-d030-4d62-af45-54f37b800ef1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.705445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.706327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.706611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.706886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] PATH_INFO: `/v3/users/4fc29ca6ee1a4d869739fd55c216fcdc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.708061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] RBAC: Authorizing `identity:get_user(user_id=4fc29ca6ee1a4d869739fd55c216fcdc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:58.709512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:58.711137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 158/306] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/users/4fc29ca6ee1a4d869739fd55c216fcdc => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:58.711855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.723910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93053f-2fde-4e26-b40a-abd10f63ccad None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.725406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:58.758619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.759408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.759685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.759955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] PATH_INFO: `/v3/users/51c0ec0a91c94976b6168d7b5716b62c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.773053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] RBAC: Authorizing `identity:get_user(user_id=51c0ec0a91c94976b6168d7b5716b62c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:58.774568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:58.776227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 149/307] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/users/51c0ec0a91c94976b6168d7b5716b62c => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:58.781499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.823432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2716578-594a-4e9f-9169-b90d64fab038 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.859737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.860789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.861631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.862094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] PATH_INFO: `/v3/groups` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.863226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:58.865299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:58.879265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19d4c8-17f5-4c6c-9a17-96e0a3e7d93e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:58.883768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 159/308] 10.222.0.47 () {60 vars in 1134 bytes} [Thu Jun 30 13:05:58 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:05:58.894521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:58.920486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:58.928772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9de4-47f6-46e1-a4eb-c87f81ae5b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:58.930040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9de4-47f6-46e1-a4eb-c87f81ae5b6c None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:58.930531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9de4-47f6-46e1-a4eb-c87f81ae5b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:58.931039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9de4-47f6-46e1-a4eb-c87f81ae5b6c None admin] PATH_INFO: `/v3/system/users/4fc29ca6ee1a4d869739fd55c216fcdc/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:58.932930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e9de4-47f6-46e1-a4eb-c87f81ae5b6c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4fc29ca6ee1a4d869739fd55c216fcdc, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:58.934799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e9de4-47f6-46e1-a4eb-c87f81ae5b6c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:58.949846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 150/309] 10.222.0.47 () {58 vars in 1334 bytes} [Thu Jun 30 13:05:58 2022] PUT /identity/v3/system/users/4fc29ca6ee1a4d869739fd55c216fcdc/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:05:59.021645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17008aa9-4af8-472e-8533-37cbf22f2653 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:59.063932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679eab-ca75-4a20-a709-cd13c35e65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:59.064604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679eab-ca75-4a20-a709-cd13c35e65d8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:59.064890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679eab-ca75-4a20-a709-cd13c35e65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:59.065166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679eab-ca75-4a20-a709-cd13c35e65d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:59.066052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc679eab-ca75-4a20-a709-cd13c35e65d8 None admin] RBAC: Adding query filter params (role.id=e2fe0be6ceca48a8b32415b51c1cd36b, user.id=51c0ec0a91c94976b6168d7b5716b62c, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:59.066421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc679eab-ca75-4a20-a709-cd13c35e65d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:59.067908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc679eab-ca75-4a20-a709-cd13c35e65d8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:59.074106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 160/310] 10.222.0.47 () {56 vars in 1308 bytes} [Thu Jun 30 13:05:58 2022] GET /identity/v3/role_assignments?user.id=51c0ec0a91c94976b6168d7b5716b62c&scope.system=all&role.id=e2fe0be6ceca48a8b32415b51c1cd36b => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:59.500702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aad0c-bdb9-42d3-b37f-89624f3284ef None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:59.501213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aad0c-bdb9-42d3-b37f-89624f3284ef None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:59.501320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aad0c-bdb9-42d3-b37f-89624f3284ef None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:59.502790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 151/311] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:05:59.508103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ac84-7c77-4a3f-a3ca-b16b02b04a54 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:59.508401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ac84-7c77-4a3f-a3ca-b16b02b04a54 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:59.508686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ac84-7c77-4a3f-a3ca-b16b02b04a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:59.526562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bbd2ac84-7c77-4a3f-a3ca-b16b02b04a54 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:05:59.527761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bbd2ac84-7c77-4a3f-a3ca-b16b02b04a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:59.599696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 161/312] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:05:59.623053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aad0c-bdb9-42d3-b37f-89624f3284ef None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:59.651506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:59.737391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aad0c-bdb9-42d3-b37f-89624f3284ef None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:59.772609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:59.773413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:59.773727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:59.774006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:59.785230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:05:59.792959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:05:59.793884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:05:59.794717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 152/313] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:05:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:05:59.801623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2ac84-7c77-4a3f-a3ca-b16b02b04a54 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:59.816602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:59.904824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2ac84-7c77-4a3f-a3ca-b16b02b04a54 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:59.939458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:59.940173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:59.940457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:59.940741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:59.941511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:05:59.941823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:59.943186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:59.951565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 162/314] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:05:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:05:59.957368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:00.046261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:00.063250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203fa26-cab3-4765-9d56-8f3e386b59d0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:00.101245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:00.102154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:00.102439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:00.102715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] PATH_INFO: `/v3/users/d09f7b4c18ac4afca6c16cd27b345af7` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:00.104177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] RBAC: Authorizing `identity:get_user(user_id=d09f7b4c18ac4afca6c16cd27b345af7)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:00.105711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:00.107633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 153/315] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:05:59 2022] GET /identity/v3/users/d09f7b4c18ac4afca6c16cd27b345af7 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:00.113066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:00.195047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:00.219280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bcde3-9091-4e74-9bec-3051717df7e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:00.254854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:00.255507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:00.255791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:00.256060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:00.325089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:00.326566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:00.407910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:00.430161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 163/316] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:00.435722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:00.537576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55992-a60f-41bf-8206-dba73ecc8783 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:00.572539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26957b-be1c-4e63-bca2-642610ebd3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:00.573408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26957b-be1c-4e63-bca2-642610ebd3ab None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:00.573726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26957b-be1c-4e63-bca2-642610ebd3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:00.574000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26957b-be1c-4e63-bca2-642610ebd3ab None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:00.575189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26957b-be1c-4e63-bca2-642610ebd3ab None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:00.576644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26957b-be1c-4e63-bca2-642610ebd3ab None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:00.578713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 154/317] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:00 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:00.584127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:00.687046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467d494-e492-419d-8fd7-241bb26abb55 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:00.722674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72772-9b80-42c6-8d64-1c7d32dcec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:00.723324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72772-9b80-42c6-8d64-1c7d32dcec30 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:00.723602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72772-9b80-42c6-8d64-1c7d32dcec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:00.723869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72772-9b80-42c6-8d64-1c7d32dcec30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:00.724694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72772-9b80-42c6-8d64-1c7d32dcec30 None admin] RBAC: Adding query filter params (role.id=e2fe0be6ceca48a8b32415b51c1cd36b, scope.project.id=6d013c02af3f48b59b1127676002583c, user.id=d09f7b4c18ac4afca6c16cd27b345af7) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:00.725051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72772-9b80-42c6-8d64-1c7d32dcec30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:00.726516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72772-9b80-42c6-8d64-1c7d32dcec30 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:00.732861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 164/318] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:00 2022] GET /identity/v3/role_assignments?user.id=d09f7b4c18ac4afca6c16cd27b345af7&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=e2fe0be6ceca48a8b32415b51c1cd36b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:01.016487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0626f1-98c1-4892-998f-60ec19c8c459 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.016884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0626f1-98c1-4892-998f-60ec19c8c459 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.017056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0626f1-98c1-4892-998f-60ec19c8c459 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.018596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 155/319] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:01.023585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234b55-c666-4715-a561-5a4b15a055af None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.023878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234b55-c666-4715-a561-5a4b15a055af None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.024155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234b55-c666-4715-a561-5a4b15a055af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.041498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3d234b55-c666-4715-a561-5a4b15a055af None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:01.042693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3d234b55-c666-4715-a561-5a4b15a055af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:01.078020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.113339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 165/320] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:01.131776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b0794-4633-48a6-812c-7cdc301f3a1a None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.132072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b0794-4633-48a6-812c-7cdc301f3a1a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.132357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b0794-4633-48a6-812c-7cdc301f3a1a None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.133898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 156/321] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:01.135638 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234b55-c666-4715-a561-5a4b15a055af None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.138396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae9275-50b4-4d66-8dfa-92c9a729926e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.138685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae9275-50b4-4d66-8dfa-92c9a729926e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.138972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae9275-50b4-4d66-8dfa-92c9a729926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.157313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8bae9275-50b4-4d66-8dfa-92c9a729926e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:01.158558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8bae9275-50b4-4d66-8dfa-92c9a729926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:01.173787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.229830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 157/322] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:01.231327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36a21-e1de-425e-9415-846c64d66e09 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.231614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36a21-e1de-425e-9415-846c64d66e09 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.231895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36a21-e1de-425e-9415-846c64d66e09 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.233189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 158/323] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:01.238406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447af35a-3a80-48eb-9c81-471b28041314 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.238694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447af35a-3a80-48eb-9c81-471b28041314 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.238974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447af35a-3a80-48eb-9c81-471b28041314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.244297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234b55-c666-4715-a561-5a4b15a055af None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:01.254803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-447af35a-3a80-48eb-9c81-471b28041314 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:01.255984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-447af35a-3a80-48eb-9c81-471b28041314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:01.278091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:01.278806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.279093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.279365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.281161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:01.282703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:01.284317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 166/324] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:01.286254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.322865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 159/325] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:01.325429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.330358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447af35a-3a80-48eb-9c81-471b28041314 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.395236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82af97e-7bb6-425b-bc9d-c83f445ec3d9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:01.410259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.430182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447af35a-3a80-48eb-9c81-471b28041314 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:01.431878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:01.432664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.432949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.433213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.443638 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:01.451358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:01.452825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:01.453667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 167/326] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:01.454322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.469652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:01.470307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.470584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.470853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] PATH_INFO: `/v3/groups` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.471527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:01.472945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:01.487224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 160/327] 10.222.0.47 () {60 vars in 1134 bytes} [Thu Jun 30 13:06:01 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:01.488224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.562269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.567591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c20e-7a61-4989-9645-0449a8cff4a2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:01.606774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:01.607582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.607718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97085-ce56-4fe0-941e-a8d43ee3d908 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:01.608138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.608211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.620693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:01.629833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:01.630814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:01.631636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 168/328] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:01.636941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.649962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:01.651173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.651173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.651173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.652052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:01.652221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:01.654018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:01.663993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 161/329] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:01.669340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.674754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.768940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94ac8-d072-474a-ac62-e622afc40b1c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:01.813981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ef4b-9763-4055-ba17-5c8277d2aec7 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:01.815557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:01.816260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.816544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.816819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.818163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:01.818163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:01.819307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:01.828867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 169/330] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:01.834568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.862531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:01.863412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:01.863808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:01.863965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] PATH_INFO: `/v3/users/4fc29ca6ee1a4d869739fd55c216fcdc` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:01.864476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.865299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] RBAC: Authorizing `identity:get_user(user_id=4fc29ca6ee1a4d869739fd55c216fcdc)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:01.866823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:01.868500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 162/331] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/users/4fc29ca6ee1a4d869739fd55c216fcdc => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:01.874936 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:01.969660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:01.980183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539e41-fda4-4099-951c-223da7590b6e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:02.010908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e07cd2-99c6-42ce-9f50-d6d36fcb42ea None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:02.020449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:02.021599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:02.022094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:02.022519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] PATH_INFO: `/v3/users/51c0ec0a91c94976b6168d7b5716b62c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:02.023932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] RBAC: Authorizing `identity:get_user(user_id=51c0ec0a91c94976b6168d7b5716b62c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:02.025573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:02.027693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 170/332] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/users/51c0ec0a91c94976b6168d7b5716b62c => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:02.033539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:02.055746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb0a0-5201-46c0-a8c3-44eec7e48972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:02.056726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb0a0-5201-46c0-a8c3-44eec7e48972 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:02.057146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb0a0-5201-46c0-a8c3-44eec7e48972 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:02.057760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb0a0-5201-46c0-a8c3-44eec7e48972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:02.058605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cb0a0-5201-46c0-a8c3-44eec7e48972 None admin] RBAC: Adding query filter params (role.id=f9fe11246d7c4aaba2b519a7f18f691a, user.id=4fc29ca6ee1a4d869739fd55c216fcdc, scope.system=all) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:02.058921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cb0a0-5201-46c0-a8c3-44eec7e48972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:02.060383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cb0a0-5201-46c0-a8c3-44eec7e48972 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:02.077664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 163/333] 10.222.0.47 () {56 vars in 1308 bytes} [Thu Jun 30 13:06:01 2022] GET /identity/v3/role_assignments?user.id=4fc29ca6ee1a4d869739fd55c216fcdc&scope.system=all&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:02.148123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:02.161792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289b5cb-3157-49e2-88ca-102b30be29a9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:02.199040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cc1b0-2e66-4004-a5c2-755de42e7d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:02.199913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc1b0-2e66-4004-a5c2-755de42e7d2c None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:02.200202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc1b0-2e66-4004-a5c2-755de42e7d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:02.200480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc1b0-2e66-4004-a5c2-755de42e7d2c None admin] PATH_INFO: `/v3/system/users/51c0ec0a91c94976b6168d7b5716b62c/roles/e2fe0be6ceca48a8b32415b51c1cd36b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:02.202081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc1b0-2e66-4004-a5c2-755de42e7d2c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=51c0ec0a91c94976b6168d7b5716b62c, role_id=e2fe0be6ceca48a8b32415b51c1cd36b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:02.203635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc1b0-2e66-4004-a5c2-755de42e7d2c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:02.216161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 171/334] 10.222.0.47 () {58 vars in 1334 bytes} [Thu Jun 30 13:06:02 2022] PUT /identity/v3/system/users/51c0ec0a91c94976b6168d7b5716b62c/roles/e2fe0be6ceca48a8b32415b51c1cd36b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:03.753666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f49f2-f7dd-4ea5-8b1c-2e5ef9dad487 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:03.754690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f49f2-f7dd-4ea5-8b1c-2e5ef9dad487 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:03.755204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f49f2-f7dd-4ea5-8b1c-2e5ef9dad487 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:03.757074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 164/335] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:03.762392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422260-c87b-40bd-901d-12e8cff86d3a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:03.763205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422260-c87b-40bd-901d-12e8cff86d3a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:03.763690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422260-c87b-40bd-901d-12e8cff86d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:03.786751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c8422260-c87b-40bd-901d-12e8cff86d3a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:03.788268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c8422260-c87b-40bd-901d-12e8cff86d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:03.880445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 172/336] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:03.926885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f49f2-f7dd-4ea5-8b1c-2e5ef9dad487 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:04.070258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f49f2-f7dd-4ea5-8b1c-2e5ef9dad487 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:04.106439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:04.120322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:04.121518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.122040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.122520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.138540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:04.146819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:04.147762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:04.148672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:04.155543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 165/337] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:04.161442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422260-c87b-40bd-901d-12e8cff86d3a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:04.260684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:04.288359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422260-c87b-40bd-901d-12e8cff86d3a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:04.330805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bc489-b3d8-4420-b19e-081da5e55fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:04.331904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bc489-b3d8-4420-b19e-081da5e55fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.332393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bc489-b3d8-4420-b19e-081da5e55fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.332873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bc489-b3d8-4420-b19e-081da5e55fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.333859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bc489-b3d8-4420-b19e-081da5e55fe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:04.334374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bc489-b3d8-4420-b19e-081da5e55fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:04.341285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bc489-b3d8-4420-b19e-081da5e55fe0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:04.357524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 173/338] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:04.358817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:04.368097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5a3c-3ffa-49a9-a94d-e2c9212e6709 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.368383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5a3c-3ffa-49a9-a94d-e2c9212e6709 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.368654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5a3c-3ffa-49a9-a94d-e2c9212e6709 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.370167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 174/339] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:04.376959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4c521-89dc-43f4-8809-3ac41c8b9fc4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.377245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4c521-89dc-43f4-8809-3ac41c8b9fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.377555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4c521-89dc-43f4-8809-3ac41c8b9fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.410620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6da4c521-89dc-43f4-8809-3ac41c8b9fc4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:04.411836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6da4c521-89dc-43f4-8809-3ac41c8b9fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:04.475817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631eee-d0d9-45af-a33f-d8387b2b1037 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:04.522118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecff6a-4f91-4105-989f-a71c6e20f36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:04.523195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecff6a-4f91-4105-989f-a71c6e20f36b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.523689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecff6a-4f91-4105-989f-a71c6e20f36b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.529297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecff6a-4f91-4105-989f-a71c6e20f36b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.556391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 175/340] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:04.594406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4c521-89dc-43f4-8809-3ac41c8b9fc4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:04.621353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:04.640731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecff6a-4f91-4105-989f-a71c6e20f36b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:04.642569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecff6a-4f91-4105-989f-a71c6e20f36b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:04.686572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:04.726367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4c521-89dc-43f4-8809-3ac41c8b9fc4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:04.797764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c281c5-2823-4a24-a2b7-795ff9d5be89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:04.798588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c281c5-2823-4a24-a2b7-795ff9d5be89 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.798874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c281c5-2823-4a24-a2b7-795ff9d5be89 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.799149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c281c5-2823-4a24-a2b7-795ff9d5be89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.816904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c281c5-2823-4a24-a2b7-795ff9d5be89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:04.821333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 166/341] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:04.823337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229241c6-6491-43b6-957e-accfcf5f5e0d None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.823852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229241c6-6491-43b6-957e-accfcf5f5e0d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.824334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229241c6-6491-43b6-957e-accfcf5f5e0d None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.825860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 167/342] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:04.830419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229241c6-6491-43b6-957e-accfcf5f5e0d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c7c281c5-2823-4a24-a2b7-795ff9d5be89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:04.831146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:04.832010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:04.832808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 176/343] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:04.841504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff4fe-be8c-4f9e-aba0-0ba4f49a916d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:04.841504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff4fe-be8c-4f9e-aba0-0ba4f49a916d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:04.841504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff4fe-be8c-4f9e-aba0-0ba4f49a916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:04.860199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6a0ff4fe-be8c-4f9e-aba0-0ba4f49a916d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:04.861316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6a0ff4fe-be8c-4f9e-aba0-0ba4f49a916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:04.941661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 177/344] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:04.942526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ff4fe-be8c-4f9e-aba0-0ba4f49a916d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:04.944301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:04.959833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229241c6-6491-43b6-957e-accfcf5f5e0d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.000587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.001657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.002045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.002442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.004287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:05.005579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:05.008580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 168/345] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:04 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:05.009524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.015025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:05.056491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ff4fe-be8c-4f9e-aba0-0ba4f49a916d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.101969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6d0f6-a295-4920-ab96-d9afaafc82c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.102880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d0f6-a295-4920-ab96-d9afaafc82c4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.103331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d0f6-a295-4920-ab96-d9afaafc82c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.103750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d0f6-a295-4920-ab96-d9afaafc82c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.105171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d0f6-a295-4920-ab96-d9afaafc82c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:05.105655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d0f6-a295-4920-ab96-d9afaafc82c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:05.108449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d0f6-a295-4920-ab96-d9afaafc82c4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:05.123448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 178/346] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:05.125519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ee67a-9822-4301-80b3-d956b0c6f12b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.125961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ee67a-9822-4301-80b3-d956b0c6f12b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.126376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ee67a-9822-4301-80b3-d956b0c6f12b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.128014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 179/347] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:05.129016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ee67a-9822-4301-80b3-d956b0c6f12b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.139699 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214a96-ab5d-4255-b8b6-474f8d9662ad None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.187781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.188788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.189178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.189581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.202805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:05.213285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:05.214725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:05.215723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 169/348] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:05.216587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.238921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:05.280750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ee67a-9822-4301-80b3-d956b0c6f12b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.313841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:05.325686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c1ebe-c464-49b9-af51-b5cc8e738dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.327344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c1ebe-c464-49b9-af51-b5cc8e738dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.327938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c1ebe-c464-49b9-af51-b5cc8e738dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.328361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c1ebe-c464-49b9-af51-b5cc8e738dd6 None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.337250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c1ebe-c464-49b9-af51-b5cc8e738dd6 None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:05.339167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c1ebe-c464-49b9-af51-b5cc8e738dd6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:05.341722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 180/349] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:05.343183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b8de-4c13-4515-a579-48fa397a7d0a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.343671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b8de-4c13-4515-a579-48fa397a7d0a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.344168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b8de-4c13-4515-a579-48fa397a7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.368423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d8e1b8de-4c13-4515-a579-48fa397a7d0a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:05.369922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d8e1b8de-4c13-4515-a579-48fa397a7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:05.372116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1991-da31-4e0c-a688-601d4e5024c2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.414737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.415357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.415641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.415914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.455886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 181/350] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:05.456730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1b8de-4c13-4515-a579-48fa397a7d0a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.504423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:05.506082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:05.525680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:05.582760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1b8de-4c13-4515-a579-48fa397a7d0a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.607420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:05.616477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 170/351] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:05.617383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.625853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.626885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.627375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.627854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.628953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:05.629486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:05.631186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:05.642787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 182/352] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:05.643872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.726424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf5c6-58f1-4533-ba7e-607707b577ee None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.742996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:05.762882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.763533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.763810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.764082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.765434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=c55d54e19f7c488c94db31aee114ae9f) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:05.765775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:05.766343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8a58c-2f70-4250-b89d-1c2556587b78 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.767208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:05.775822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 171/353] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:05.776646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.808434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.810347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.811102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.811882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.826176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:05.835801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:05.836691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 13:06:05.837536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:05.840570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 183/354] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:05.842879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:05.902091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:05.917639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a515661-7525-490a-83db-b7c198f97961 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:05.958114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:05.958997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:05.959274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:05.959546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:05.966174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:05.967727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:05.969798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 172/355] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:05.970405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:06.026581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234eaee7-0f08-4936-b71c-5a16615274ec None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:06.062030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:06.080961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:06.081665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.081954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.082228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.120622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d9e88-3643-43fb-9a81-704e5ca7a3e8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:06.166248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:06.167333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.167681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.168023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.168867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:06.169242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:06.170822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:06.182225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 173/356] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:06.183322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:06.198637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:06.200130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:06.301317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296b80-0177-4df8-acd8-4ce9525343f2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:06.301830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:06.314220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:06.351310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fedb36-a74e-44bd-b67e-4d62742144d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:06.352194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedb36-a74e-44bd-b67e-4d62742144d2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.352474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedb36-a74e-44bd-b67e-4d62742144d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.352746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedb36-a74e-44bd-b67e-4d62742144d2 None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.354508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fedb36-a74e-44bd-b67e-4d62742144d2 None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:06.356074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fedb36-a74e-44bd-b67e-4d62742144d2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:06.358679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 174/357] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:06 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:06.360024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64761d4-ee3e-4299-bafd-3edf058d1dc1 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.360313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64761d4-ee3e-4299-bafd-3edf058d1dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.360588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64761d4-ee3e-4299-bafd-3edf058d1dc1 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.362020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 175/358] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:06.362532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64761d4-ee3e-4299-bafd-3edf058d1dc1 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:06.412282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 184/359] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:06.413212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:06.516738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64761d4-ee3e-4299-bafd-3edf058d1dc1 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:06.567546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e93801-3a28-4c5f-ac6b-2c660259ffd4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:06.567730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914972f-bb1d-41aa-bf35-00c329af0af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:06.568478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914972f-bb1d-41aa-bf35-00c329af0af7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.568756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914972f-bb1d-41aa-bf35-00c329af0af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.569132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914972f-bb1d-41aa-bf35-00c329af0af7 None admin] PATH_INFO: `/v3/users/51c0ec0a91c94976b6168d7b5716b62c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.571877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914972f-bb1d-41aa-bf35-00c329af0af7 None admin] RBAC: Authorizing `identity:get_user(user_id=51c0ec0a91c94976b6168d7b5716b62c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:06.573321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914972f-bb1d-41aa-bf35-00c329af0af7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:06.575392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 176/360] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:06:06 2022] GET /identity/v3/users/51c0ec0a91c94976b6168d7b5716b62c => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:06.576562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450beb-5ca1-456e-aac0-68101c096a74 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.576891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450beb-5ca1-456e-aac0-68101c096a74 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.578369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450beb-5ca1-456e-aac0-68101c096a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.603738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-82450beb-5ca1-456e-aac0-68101c096a74 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:06.604681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:06.604946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-82450beb-5ca1-456e-aac0-68101c096a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:06.606413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.606413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.606413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.606897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=c55d54e19f7c488c94db31aee114ae9f) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:06.607217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:06.610534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:06.618170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 185/361] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:06 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:06.626848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:06.647559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:06.704425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:06.742264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 177/362] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:06.743620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9af1d-4d85-4b6a-86af-ce295eea49c0 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.743903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9af1d-4d85-4b6a-86af-ce295eea49c0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.744179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9af1d-4d85-4b6a-86af-ce295eea49c0 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.750904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 178/363] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:06.751760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9af1d-4d85-4b6a-86af-ce295eea49c0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:06.840536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610cc4-8eb0-4381-9ee1-a545ba560666 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:06.877746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec433bd-e837-4a71-b047-e024541ee00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:06.879084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec433bd-e837-4a71-b047-e024541ee00f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.879564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec433bd-e837-4a71-b047-e024541ee00f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.880120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec433bd-e837-4a71-b047-e024541ee00f None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.881537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec433bd-e837-4a71-b047-e024541ee00f None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:06.883291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec433bd-e837-4a71-b047-e024541ee00f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:06.885361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 186/364] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:06 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:06.887845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93cdc-7fdf-4f54-b7af-510ba6b179ee None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.888347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93cdc-7fdf-4f54-b7af-510ba6b179ee None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.888850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93cdc-7fdf-4f54-b7af-510ba6b179ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.900442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9af1d-4d85-4b6a-86af-ce295eea49c0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:06.907431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-15d93cdc-7fdf-4f54-b7af-510ba6b179ee None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:06.908959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-15d93cdc-7fdf-4f54-b7af-510ba6b179ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:06.939596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:06.940309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:06.940622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:06.940858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:06.941776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] RBAC: Adding query filter params (role.id=e2fe0be6ceca48a8b32415b51c1cd36b, user.id=51c0ec0a91c94976b6168d7b5716b62c, scope.system=all) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:06.942089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:06.943808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:06.957097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 179/365] 10.222.0.47 () {56 vars in 1308 bytes} [Thu Jun 30 13:06:06 2022] GET /identity/v3/role_assignments?user.id=51c0ec0a91c94976b6168d7b5716b62c&scope.system=all&role.id=e2fe0be6ceca48a8b32415b51c1cd36b => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:06.958058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:06.998214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.008557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 187/366] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:07.009934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d93cdc-7fdf-4f54-b7af-510ba6b179ee None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:07.014724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.077337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301801b-8633-4119-ae92-ca3d5d837b31 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.119673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.120300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.120588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.120865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.142651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:07.155920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:07.156917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:07.157762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 180/367] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:07.158439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:07.160622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d93cdc-7fdf-4f54-b7af-510ba6b179ee None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.199934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.201198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.202293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.202855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.204426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:07.206464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:07.208539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 188/368] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:07 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:07.210647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:07.297935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.306743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.321532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c6fde-bb71-4af8-9cc5-e0062047719b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.343323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc09fd-855a-41eb-aa57-d30d070dd88a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.371675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.372849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.373199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.374026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.390401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:07.394263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.395188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.395939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.396416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.397362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:07.397910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:07.399382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:07.400251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:07.401065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:07.402295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 181/369] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:07.402744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:07.402921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:07.413701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 189/370] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:07.415498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:07.541894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b79d-348e-45d1-bea3-1b58c88858d8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.559025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c3695-589f-4efe-99b2-34df3a281e27 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.589649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.590518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.590810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.591090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.593045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=6d013c02af3f48b59b1127676002583c) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:07.593045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:07.593913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:07.602350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 182/371] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:07 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:07.602953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:07.610718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.611794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.612313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.612792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.613837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:07.615139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:07.617420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:07.619804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.629282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.634732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 190/372] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:07.641162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:07.746851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c543bd-30cd-460d-9927-e4a276c77a38 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.781254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f458-ba46-4fbb-b6bb-5dd09fc20c7d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:07.786541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.787550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.788036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.788512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.820354 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:07.821014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:07.821300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:07.821629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:07.868732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:07.870587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:07.902999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.912227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:07.922534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:07.924646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:08.007773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 183/373] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:08.013679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:08.059444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 191/374] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:08.065730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:08.135035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6b58-e399-453e-a2c6-23ce7506360c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:08.153369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:08.174851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:08.174851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.174851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.174851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.175691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:08.177171 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:08.178929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 184/375] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:08 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:08.184541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:08.188598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:08.201614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6556b-a8a4-4b84-a487-bc9dcc4cfa1e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:08.251065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:08.252251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.252713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.253162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] PATH_INFO: `/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.254560 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ffb94c3eb4e4540b84c4cb9fb570f96)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:08.256186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:08.258403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 192/376] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:08 2022] GET /identity/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:08.264966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:08.378512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a843c1e-76ee-4951-849d-17463aed2835 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:08.432339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:08.433763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.435035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.436117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.439261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:08.440956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:08.441604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1983-d5ff-4b9c-b837-3595fe1e30a1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:08.444866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 185/377] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:08 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:08.452578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:08.499198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:08.500424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.501045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.501602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] PATH_INFO: `/v3/groups/34ebe1aa35994c24a6408479b646e810` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.507299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] RBAC: Authorizing `identity:get_group(group_id=34ebe1aa35994c24a6408479b646e810)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:08.511863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:08.514733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 193/378] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:08 2022] GET /identity/v3/groups/34ebe1aa35994c24a6408479b646e810 => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:08.522562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:08.558806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:08.569925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:08.637635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15760bc8-2f81-49ee-9106-f15c1f16c1ce None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:08.670966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eb722-98d5-43f9-bb66-ca6124f32f9b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:08.681224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf9f9f-ed7d-40ec-b5b7-e8e8cf7e8316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:08.682220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9f9f-ed7d-40ec-b5b7-e8e8cf7e8316 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.682832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9f9f-ed7d-40ec-b5b7-e8e8cf7e8316 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.683311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9f9f-ed7d-40ec-b5b7-e8e8cf7e8316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.684459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9f9f-ed7d-40ec-b5b7-e8e8cf7e8316 None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=6d013c02af3f48b59b1127676002583c) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:08.684976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9f9f-ed7d-40ec-b5b7-e8e8cf7e8316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:08.686762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9f9f-ed7d-40ec-b5b7-e8e8cf7e8316 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:08.693556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 186/379] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:08 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:08.695208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6769-9695-4df1-8088-47527d2981f1 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.695704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6769-9695-4df1-8088-47527d2981f1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.696205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6769-9695-4df1-8088-47527d2981f1 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.698278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 187/380] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:08.710493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7813f-941e-4c65-870a-37bdb1a763d4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.710827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7813f-941e-4c65-870a-37bdb1a763d4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.711058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7813f-941e-4c65-870a-37bdb1a763d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.718164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:08.719360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:08.719891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:08.720367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:08.721412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] RBAC: Adding query filter params (group.id=34ebe1aa35994c24a6408479b646e810, role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=7ffb94c3eb4e4540b84c4cb9fb570f96) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:08.722071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:08.723803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:08.730879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 194/381] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:08 2022] GET /identity/v3/role_assignments?group.id=34ebe1aa35994c24a6408479b646e810&scope.project.id=7ffb94c3eb4e4540b84c4cb9fb570f96&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:08.734690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2cf7813f-941e-4c65-870a-37bdb1a763d4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:08.735915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2cf7813f-941e-4c65-870a-37bdb1a763d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:08.836920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 188/382] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:08.864504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:08.968747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:08.978634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d71dd7-12bb-4a61-9f50-4bce3ef75e63 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.014962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00668e-cd24-4034-ba5b-98204bfd7137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.015770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00668e-cd24-4034-ba5b-98204bfd7137 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.016058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00668e-cd24-4034-ba5b-98204bfd7137 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.016337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00668e-cd24-4034-ba5b-98204bfd7137 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.028087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00668e-cd24-4034-ba5b-98204bfd7137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0c00668e-cd24-4034-ba5b-98204bfd7137 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:09.037271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:09.038252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:09.039107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 195/383] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:09.043371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7813f-941e-4c65-870a-37bdb1a763d4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:09.112621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:09.151963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d49df-0802-4d95-8e3b-ec02b4296377 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.152697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d49df-0802-4d95-8e3b-ec02b4296377 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.153716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d49df-0802-4d95-8e3b-ec02b4296377 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.155677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 196/384] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:09.160691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a62070-0dea-4d7c-bd55-12348808c970 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.161239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a62070-0dea-4d7c-bd55-12348808c970 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.161744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a62070-0dea-4d7c-bd55-12348808c970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.181253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7813f-941e-4c65-870a-37bdb1a763d4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.194521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-75a62070-0dea-4d7c-bd55-12348808c970 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:09.196060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-75a62070-0dea-4d7c-bd55-12348808c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:09.223094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.223696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.223986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.224262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.225007 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:09.225311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:09.226736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:09.248375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 189/385] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:09.255481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:09.339506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 197/386] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:09.377088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a62070-0dea-4d7c-bd55-12348808c970 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:09.433124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f581-328b-46a5-b495-ba99b46a38d6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.455829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:09.495605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.496833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.500298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.500803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.503216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:09.504955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:09.507041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 190/387] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:09 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:09.512464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:09.522372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:09.549480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a62070-0dea-4d7c-bd55-12348808c970 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.588917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.590106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.590593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.591107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.604535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:09.613927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:09.614802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:09.615602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:09.618275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 198/388] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:09.624468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:09.648446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b418-7591-4c51-bc76-687e509e5964 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.688460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.689331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.689698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.689926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.691270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:09.692824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:09.694576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 191/389] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:09 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:09.700483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:09.743336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a91d8-ca71-4d00-8a00-07ba7e9b3a56 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.754746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:09.783999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.785010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.785654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.786164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.787111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:09.787654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:09.789277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:09.799535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 199/390] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:09.805851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:09.812767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:09.816802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ad796-dd23-4f00-a17b-53d8b886306d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.859947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.860843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.861131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.861409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.863545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] RBAC: Authorizing `identity:create_grant(project_id=c55d54e19f7c488c94db31aee114ae9f, group_id=cc4f189036f143ab9eaf063b3eb3731e, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:09.865114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:09.884275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 192/391] 10.222.0.47 () {58 vars in 1442 bytes} [Thu Jun 30 13:06:09 2022] PUT /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:09.933399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e466b-8aac-4fbc-ac5f-3aa1ded8b434 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:09.973197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:09.974953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:09.975489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:09.975995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:09.977660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:09.979382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:09.981743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 200/392] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:09 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:09.988043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:10.124879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dce571-c9c9-4869-af52-88fbea02e6da None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:10.134978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:10.167287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415f573-ade5-4999-8ff6-c8b81cc75924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:10.168177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415f573-ade5-4999-8ff6-c8b81cc75924 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:10.168468 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415f573-ade5-4999-8ff6-c8b81cc75924 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:10.168751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415f573-ade5-4999-8ff6-c8b81cc75924 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:10.170023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415f573-ade5-4999-8ff6-c8b81cc75924 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:10.171626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415f573-ade5-4999-8ff6-c8b81cc75924 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:10.173692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 193/393] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:09 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:10.179018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:10.263458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:10.297780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaddd7-53ac-4a03-9256-332921447164 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:10.319558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ebbd6-3de9-4c5a-918d-1fb3922dbe3f None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:10.319850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ebbd6-3de9-4c5a-918d-1fb3922dbe3f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:10.320113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ebbd6-3de9-4c5a-918d-1fb3922dbe3f None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:10.321786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 194/394] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:10.329098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058152d-d045-416f-a065-57c7c6121e20 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:10.329383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058152d-d045-416f-a065-57c7c6121e20 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:10.329688 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058152d-d045-416f-a065-57c7c6121e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:10.337336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:10.338262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:10.338551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:10.339083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:10.347204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55d54e19f7c488c94db31aee114ae9f, group_id=cc4f189036f143ab9eaf063b3eb3731e, role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:10.348686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:10.351810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3058152d-d045-416f-a065-57c7c6121e20 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:10.353210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3058152d-d045-416f-a065-57c7c6121e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:10.377594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 201/395] 10.222.0.47 () {58 vars in 1442 bytes} [Thu Jun 30 13:06:10 2022] PUT /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:10.467225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 195/396] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:10.502116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:10.640227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dde3f-d61c-4f89-b5e1-55a460c67104 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:10.673189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:10.679094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:10.679985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:10.680267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:10.680584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:10.696314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:10.704621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:10.705618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:10.706800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 202/397] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:10.712013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058152d-d045-416f-a065-57c7c6121e20 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:10.817605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058152d-d045-416f-a065-57c7c6121e20 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:10.822507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:10.860243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:10.860962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:10.861246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:10.861538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:10.862283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:10.862584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:10.863949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:10.873544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 196/398] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:10.879065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:10.999465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd110c3-8272-415b-8fcf-a8b8c409f44b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:11.047151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:11.048300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.048745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.049158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.050504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:11.052091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:11.053876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 203/399] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:10 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:11.059768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:11.174047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7413f-55ed-4d5a-b3f7-080c51247682 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:11.225977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7b917-089a-4259-8969-a154af56123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:11.227123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b917-089a-4259-8969-a154af56123d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.227543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b917-089a-4259-8969-a154af56123d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.228040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b917-089a-4259-8969-a154af56123d None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.229373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7b917-089a-4259-8969-a154af56123d None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:11.231025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7b917-089a-4259-8969-a154af56123d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:11.233182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 197/400] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:11 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:11.239022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:11.308461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:11.372260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf6227-76a5-40df-b8a8-6335876baddb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:11.416866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c87941-9544-4b19-a7a4-bb30498501cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:11.418066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87941-9544-4b19-a7a4-bb30498501cb None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.418490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87941-9544-4b19-a7a4-bb30498501cb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.418900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87941-9544-4b19-a7a4-bb30498501cb None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.421098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c87941-9544-4b19-a7a4-bb30498501cb None admin] RBAC: Authorizing `identity:create_grant(project_id=6d013c02af3f48b59b1127676002583c, group_id=cc4f189036f143ab9eaf063b3eb3731e, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:11.422734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c87941-9544-4b19-a7a4-bb30498501cb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:11.447452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 204/401] 10.222.0.47 () {58 vars in 1442 bytes} [Thu Jun 30 13:06:11 2022] PUT /identity/v3/projects/6d013c02af3f48b59b1127676002583c/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:11.659917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31b77-3ebb-4658-ac7a-ffa892146244 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.660469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31b77-3ebb-4658-ac7a-ffa892146244 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.660978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31b77-3ebb-4658-ac7a-ffa892146244 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.662621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 198/402] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:11.668137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820f5c-9451-45f9-ad23-da283a2b85bd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.668692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820f5c-9451-45f9-ad23-da283a2b85bd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.669160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820f5c-9451-45f9-ad23-da283a2b85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.692461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-81820f5c-9451-45f9-ad23-da283a2b85bd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:11.694135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-81820f5c-9451-45f9-ad23-da283a2b85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:11.779754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 205/403] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:11.806331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f31b77-3ebb-4658-ac7a-ffa892146244 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:11.846522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:11.927925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f31b77-3ebb-4658-ac7a-ffa892146244 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:11.957093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505937-f69a-49e2-aa55-2502ee5f6c71 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.957404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505937-f69a-49e2-aa55-2502ee5f6c71 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.957683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505937-f69a-49e2-aa55-2502ee5f6c71 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.959309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 206/404] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:11.965825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2205938-5e7d-42e2-b938-725c8eb62e06 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.966114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2205938-5e7d-42e2-b938-725c8eb62e06 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.966396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2205938-5e7d-42e2-b938-725c8eb62e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.973016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:11.981491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:11.981491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:11.981491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:11.985410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:11.993828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:11.994813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:11.995665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 199/405] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:12.000536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e2205938-5e7d-42e2-b938-725c8eb62e06 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:12.002783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e2205938-5e7d-42e2-b938-725c8eb62e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:12.010466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.085830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:12.131931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 207/406] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:12.157166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2205938-5e7d-42e2-b938-725c8eb62e06 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.203230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:12.227667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380f76f-7c52-4ea2-9d6a-00c2cf807d38 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:12.285641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2205938-5e7d-42e2-b938-725c8eb62e06 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:12.312464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:12.313138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.313419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.313724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.314468 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:12.314771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:12.316141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:12.337157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 200/407] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:12.341503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.357813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:12.358466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.358745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.359065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.380320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:12.394520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:12.395460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:12.396248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:12.398607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 208/408] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:12.403556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.487922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:12.508416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b1a85-ffa5-43a7-b7c2-6e73cafcb772 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:12.571414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:12.572277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.572561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.572831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.577181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:12.581015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:12.588182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 201/409] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:12 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:12.589320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.607049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c168328-2f7f-4410-9bb8-c88cf20e7e54 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:12.642903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:12.651410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:12.652171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.652456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.652726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.653489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:12.653782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:12.655191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:12.674333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 209/410] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:12.677423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.782835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e2d3-8446-43ae-8b2b-bf7c81a3e9d0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:12.784405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e9d10-05f9-460d-9b36-edc4e29c3c28 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:12.791168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:12.821781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed47a9d-4000-46ae-ab5d-a19008471d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:12.822863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47a9d-4000-46ae-ab5d-a19008471d14 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.823259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47a9d-4000-46ae-ab5d-a19008471d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.823634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47a9d-4000-46ae-ab5d-a19008471d14 None admin] PATH_INFO: `/v3/groups/34ebe1aa35994c24a6408479b646e810` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.824869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed47a9d-4000-46ae-ab5d-a19008471d14 None admin] RBAC: Authorizing `identity:get_group(group_id=34ebe1aa35994c24a6408479b646e810)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:12.826424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed47a9d-4000-46ae-ab5d-a19008471d14 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:12.828369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be288-c490-44f0-8179-4b6a84418fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:12.829070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 210/411] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:12 2022] GET /identity/v3/groups/34ebe1aa35994c24a6408479b646e810 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:12.829589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be288-c490-44f0-8179-4b6a84418fef None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.830072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be288-c490-44f0-8179-4b6a84418fef None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.830499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be288-c490-44f0-8179-4b6a84418fef None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.830608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45e2a-9cf3-4b97-baeb-10f327e39532 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.830993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45e2a-9cf3-4b97-baeb-10f327e39532 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.831376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45e2a-9cf3-4b97-baeb-10f327e39532 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.832149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56be288-c490-44f0-8179-4b6a84418fef None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:12.832995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 211/412] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:12.833935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56be288-c490-44f0-8179-4b6a84418fef None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:12.835764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 202/413] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:12 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:12.841479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da45e2a-9cf3-4b97-baeb-10f327e39532 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.843311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdbef3-463c-4871-a7ee-18768f1838f7 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:12.843831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdbef3-463c-4871-a7ee-18768f1838f7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:12.844318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdbef3-463c-4871-a7ee-18768f1838f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:12.864903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0bfdbef3-463c-4871-a7ee-18768f1838f7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:12.866267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0bfdbef3-463c-4871-a7ee-18768f1838f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:12.946201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 203/414] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:12.947056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdbef3-463c-4871-a7ee-18768f1838f7 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:12.968895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da45e2a-9cf3-4b97-baeb-10f327e39532 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:12.986239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.006622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.008323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.008796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.009225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.012026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d013c02af3f48b59b1127676002583c, group_id=cc4f189036f143ab9eaf063b3eb3731e, role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:13.013869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:13.034379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 212/415] 10.222.0.47 () {58 vars in 1442 bytes} [Thu Jun 30 13:06:12 2022] PUT /identity/v3/projects/6d013c02af3f48b59b1127676002583c/groups/cc4f189036f143ab9eaf063b3eb3731e/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:13.035479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.110455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.126672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdbef3-463c-4871-a7ee-18768f1838f7 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:13.197030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b4506-6bc7-4485-bceb-0e28710eed69 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:13.197934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d825d1-2b5f-4c81-a7f8-b276660b7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.198805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d825d1-2b5f-4c81-a7f8-b276660b7b55 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.199089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d825d1-2b5f-4c81-a7f8-b276660b7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.199365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d825d1-2b5f-4c81-a7f8-b276660b7b55 None admin] PATH_INFO: `/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.201415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d825d1-2b5f-4c81-a7f8-b276660b7b55 None admin] RBAC: Authorizing `identity:get_project(project_id=7ffb94c3eb4e4540b84c4cb9fb570f96)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:13.202153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d825d1-2b5f-4c81-a7f8-b276660b7b55 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:13.204109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 204/416] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:12 2022] GET /identity/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96 => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:13.205375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608736b1-c38e-4aab-babb-9504401cbf0d None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.210455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608736b1-c38e-4aab-babb-9504401cbf0d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.210774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608736b1-c38e-4aab-babb-9504401cbf0d None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.212521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 205/417] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:13.213389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608736b1-c38e-4aab-babb-9504401cbf0d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.241411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010cfd7-a0de-4ba8-8c4d-91dda1b5b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.242467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010cfd7-a0de-4ba8-8c4d-91dda1b5b187 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.242890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010cfd7-a0de-4ba8-8c4d-91dda1b5b187 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.243396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010cfd7-a0de-4ba8-8c4d-91dda1b5b187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.258732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010cfd7-a0de-4ba8-8c4d-91dda1b5b187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5010cfd7-a0de-4ba8-8c4d-91dda1b5b187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:13.267618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:13.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:13.269403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 213/418] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:13.273648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45c7c-f07e-4425-8599-d34b58fc8e1a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.273648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45c7c-f07e-4425-8599-d34b58fc8e1a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.273648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45c7c-f07e-4425-8599-d34b58fc8e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.296437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-13d45c7c-f07e-4425-8599-d34b58fc8e1a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:13.297850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-13d45c7c-f07e-4425-8599-d34b58fc8e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:13.324626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.343105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608736b1-c38e-4aab-babb-9504401cbf0d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:13.382601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.383485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.383767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.384042 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] PATH_INFO: `/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96/groups/34ebe1aa35994c24a6408479b646e810/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.386125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ffb94c3eb4e4540b84c4cb9fb570f96, group_id=34ebe1aa35994c24a6408479b646e810, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:13.387614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:13.393401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 214/419] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:13.394734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45c7c-f07e-4425-8599-d34b58fc8e1a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.418077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.423502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 206/420] 10.222.0.47 () {58 vars in 1442 bytes} [Thu Jun 30 13:06:13 2022] PUT /identity/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96/groups/34ebe1aa35994c24a6408479b646e810/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:13.441482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.512088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45c7c-f07e-4425-8599-d34b58fc8e1a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:13.564185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.564877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.565161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.565437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.567307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:13.567622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:13.570491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:13.584079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 215/421] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:13.588547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.625434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b3805-e3b0-44d3-b056-14aa5bf98622 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:13.690910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.692767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.693334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.693860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.705249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:13.714344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:13.715254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:13.716059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:13.719271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 207/422] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:13.719406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.725334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.743310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.750469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e726cc-2ef9-4301-bad4-02ae4d5cc4ab None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:13.791051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.791708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.791997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.792278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.837905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e8ec-49ea-4ac9-924f-2b79c68522bd None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:13.864458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:13.866126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:13.874090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:13.875053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:13.875533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:13.876003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:13.876970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:13.877533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:13.879117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:13.888118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 208/423] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:13.894359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.952182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.973844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 216/424] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:13.983861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:13.988055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:14.027273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde090-3817-4a3c-83e2-0262c52c16d1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.063097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ec693-b9da-4801-9a81-42bde2b5b109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.063883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec693-b9da-4801-9a81-42bde2b5b109 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.064165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec693-b9da-4801-9a81-42bde2b5b109 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.064435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec693-b9da-4801-9a81-42bde2b5b109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.119054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751278b9-01ee-4668-8321-b119f18dd852 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.141493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ec693-b9da-4801-9a81-42bde2b5b109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.143015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ec693-b9da-4801-9a81-42bde2b5b109 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.161522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791219e-49fc-4560-9f6c-02a468a528c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.162666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791219e-49fc-4560-9f6c-02a468a528c3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.162950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791219e-49fc-4560-9f6c-02a468a528c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.163226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791219e-49fc-4560-9f6c-02a468a528c3 None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.164429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791219e-49fc-4560-9f6c-02a468a528c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.166453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791219e-49fc-4560-9f6c-02a468a528c3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.169627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 217/425] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:13 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:14.170946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fbe55-eb7b-4bc7-a7c2-7c78fbc6053b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.171231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fbe55-eb7b-4bc7-a7c2-7c78fbc6053b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.171504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fbe55-eb7b-4bc7-a7c2-7c78fbc6053b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.176831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 218/426] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:14.177795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fbe55-eb7b-4bc7-a7c2-7c78fbc6053b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:14.226376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:14.242185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:14.264763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 209/427] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:14.266335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05f8e-36ac-4ed9-965d-94891fa60321 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.266777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05f8e-36ac-4ed9-965d-94891fa60321 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.267191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05f8e-36ac-4ed9-965d-94891fa60321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.286471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e8e05f8e-36ac-4ed9-965d-94891fa60321 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:14.288061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e8e05f8e-36ac-4ed9-965d-94891fa60321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:14.314038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fbe55-eb7b-4bc7-a7c2-7c78fbc6053b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.353844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.354699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.355033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.355307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.356520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.358070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.360093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 219/428] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:14 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:14.360873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:14.379691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 210/429] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:14.385481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05f8e-36ac-4ed9-965d-94891fa60321 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:14.501914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05f8e-36ac-4ed9-965d-94891fa60321 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.503505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:14.509439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799e54-eefb-47ae-a2b1-887a74f8130e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.529675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:14.547673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.548323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.548605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.548877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.549938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=c55d54e19f7c488c94db31aee114ae9f) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:14.550252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.551768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.552831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.554154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.555053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.555549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] PATH_INFO: `/v3/projects/c55d54e19f7c488c94db31aee114ae9f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.557165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] RBAC: Authorizing `identity:get_project(project_id=c55d54e19f7c488c94db31aee114ae9f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.558190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 211/430] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:14 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:14.559032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:14.559415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.562345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 220/431] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:14 2022] GET /identity/v3/projects/c55d54e19f7c488c94db31aee114ae9f => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:14.567642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:14.676797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb89a4-d10e-4cb7-b2b4-07b918603640 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.701277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4980d5-8762-48b3-b0d1-7315298c24bf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.730819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.735263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.735552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.735828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.758627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.759620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.759905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.760174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.761431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.762917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.765015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 221/432] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:14 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:14.766448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:14.770916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:14.778992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:14.779988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 13:06:14.780774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:14.783000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 212/433] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:14.787709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:14.838172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:14.839787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:14.903585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e24f4-165d-46f6-a9e1-ab7a4fcbc7f7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.931160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb015-7d8b-4f72-bb36-0c46c7e4c85e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:14.951389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.952087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.952367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.952640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.953503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=c55d54e19f7c488c94db31aee114ae9f) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:14.953830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.957854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.963088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 222/434] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:14 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=c55d54e19f7c488c94db31aee114ae9f&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:14.979558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:14.980637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:14.981154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:14.981715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:14.982792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:14.983860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:14.985591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:14.996287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 213/435] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:06:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:15.001615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:15.118199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826afcb-1a38-478f-b39d-e68aa032b0ac None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:15.136581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:15.153975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c241-10aa-4634-b424-5790465997fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:15.155635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c241-10aa-4634-b424-5790465997fe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.156159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c241-10aa-4634-b424-5790465997fe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.156843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c241-10aa-4634-b424-5790465997fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.236569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071c241-10aa-4634-b424-5790465997fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:15.238177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071c241-10aa-4634-b424-5790465997fe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:15.351045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 223/436] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:15.357018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:15.441788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e460f6-db37-4dc4-88a3-10f19b5f67c4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.442108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e460f6-db37-4dc4-88a3-10f19b5f67c4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.442346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e460f6-db37-4dc4-88a3-10f19b5f67c4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.443973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 224/437] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:15.449025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622a20-cc52-43e6-bdef-6e72b7bdb418 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.449307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622a20-cc52-43e6-bdef-6e72b7bdb418 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.449645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622a20-cc52-43e6-bdef-6e72b7bdb418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.461053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:15.474779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8d622a20-cc52-43e6-bdef-6e72b7bdb418 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:15.476050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8d622a20-cc52-43e6-bdef-6e72b7bdb418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:15.477227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48adde-934d-4e2e-829e-4379c194d4b7 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:15.496044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:15.527832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:15.528882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.529174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.529446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.533103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:15.534172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:15.535610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 214/438] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:15 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:15.541795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:15.580527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 225/439] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:15.605567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d622a20-cc52-43e6-bdef-6e72b7bdb418 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:15.660469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92871c50-5db9-4285-9288-be5de9f15db1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:15.698398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:15.699536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.699821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.700099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.701349 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:15.702880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:15.711287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 215/440] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:15 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:15.713900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:15.720607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d622a20-cc52-43e6-bdef-6e72b7bdb418 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:15.744550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:15.756979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:15.757744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.758029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.758301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.769877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:15.777960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:15.778916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:15.780455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 226/441] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:15.785264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:15.798829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:15.832189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f046d3-d91e-4eae-8d62-6af73cee599d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:15.869692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e8d81-5fa4-464e-ab35-d0a400fd217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:15.870348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8d81-5fa4-464e-ab35-d0a400fd217f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.870634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8d81-5fa4-464e-ab35-d0a400fd217f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.870911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8d81-5fa4-464e-ab35-d0a400fd217f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.871740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e8d81-5fa4-464e-ab35-d0a400fd217f None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=f9fe11246d7c4aaba2b519a7f18f691a, scope.project.id=6d013c02af3f48b59b1127676002583c) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:15.872058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e8d81-5fa4-464e-ab35-d0a400fd217f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:15.873530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e8d81-5fa4-464e-ab35-d0a400fd217f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:15.879666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 216/442] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:15 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=f9fe11246d7c4aaba2b519a7f18f691a => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:15.881029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685390-c522-4be4-b186-1eeda21c8464 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.881319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685390-c522-4be4-b186-1eeda21c8464 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.881612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685390-c522-4be4-b186-1eeda21c8464 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.883009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 217/443] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:15.888471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f059a7-73c9-41fb-ab28-b02ad9539f51 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.888805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f059a7-73c9-41fb-ab28-b02ad9539f51 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.889073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f059a7-73c9-41fb-ab28-b02ad9539f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.900128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8e48c-23ca-4c9a-9816-c788fde43670 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:15.910112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-50f059a7-73c9-41fb-ab28-b02ad9539f51 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:15.911767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-50f059a7-73c9-41fb-ab28-b02ad9539f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:15.937826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:15.938520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:15.938812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:15.939098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:15.939865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:15.940181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:15.941621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:15.955102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 227/444] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:15.956347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.005167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 218/445] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:16.029637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f059a7-73c9-41fb-ab28-b02ad9539f51 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.039736 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.051030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.075406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f906-8042-4171-9b3e-9e0d828c4b90 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.116439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.117099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.117386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.117706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.148865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f059a7-73c9-41fb-ab28-b02ad9539f51 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.193335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.194170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.194453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.194733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.197949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.199412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.207539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:16.216215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:16.217893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:16.218907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 219/446] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:16.225387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.277164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.306696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.308961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 228/447] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:16.314535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.333288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e0d8e-cb82-4bd3-b850-467922d186ce None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.367624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.368339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.368638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.368914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.369683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:16.369996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.371362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.379869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 220/448] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:16.385297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.415985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668ebc-d94b-48ba-ad89-95015abc2a6c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.449142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.450223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.450503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.450776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] PATH_INFO: `/v3/projects/6d013c02af3f48b59b1127676002583c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.452615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=6d013c02af3f48b59b1127676002583c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.454076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.455754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 229/449] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/projects/6d013c02af3f48b59b1127676002583c => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:16.460969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.483729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d71e3a-6a1b-4ba9-9544-2936a14b276d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.499269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.518184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.518829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.519111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.519387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.529568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.558651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f000192-f567-4ec0-b9fc-731f839bb0d3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.585711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.587151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.592813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.593678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.593964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.594242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] PATH_INFO: `/v3/groups/cc4f189036f143ab9eaf063b3eb3731e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.595413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] RBAC: Authorizing `identity:get_group(group_id=cc4f189036f143ab9eaf063b3eb3731e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.596845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.598501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 230/450] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/groups/cc4f189036f143ab9eaf063b3eb3731e => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:16.604065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.682234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 221/451] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:16.688306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.704987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7627fb-3283-4ca6-9414-047acdcf9440 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.712793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.728395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.742275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.742923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.743208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.743484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.744307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] RBAC: Adding query filter params (group.id=cc4f189036f143ab9eaf063b3eb3731e, role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=6d013c02af3f48b59b1127676002583c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:16.744620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.746089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.752603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 231/452] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/role_assignments?group.id=cc4f189036f143ab9eaf063b3eb3731e&scope.project.id=6d013c02af3f48b59b1127676002583c&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:16.788065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0ff57-90b0-4d42-a0c3-f29cb7276383 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.825071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.825888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.826170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.826482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] PATH_INFO: `/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.827721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ffb94c3eb4e4540b84c4cb9fb570f96)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.829164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.830934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 222/453] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/projects/7ffb94c3eb4e4540b84c4cb9fb570f96 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:16.836584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:16.939171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb99d-78c3-40cf-ad9b-a9480e084956 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:16.972966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f8c64-0813-456d-a2bf-6f2d747b3dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:16.973844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8c64-0813-456d-a2bf-6f2d747b3dca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:16.974132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8c64-0813-456d-a2bf-6f2d747b3dca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:16.974408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8c64-0813-456d-a2bf-6f2d747b3dca None admin] PATH_INFO: `/v3/groups/34ebe1aa35994c24a6408479b646e810` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:16.975575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f8c64-0813-456d-a2bf-6f2d747b3dca None admin] RBAC: Authorizing `identity:get_group(group_id=34ebe1aa35994c24a6408479b646e810)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:16.977014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f8c64-0813-456d-a2bf-6f2d747b3dca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:16.978668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 232/454] 10.222.0.47 () {56 vars in 1180 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/groups/34ebe1aa35994c24a6408479b646e810 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:16.984947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:17.085275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f3faf-d0e8-4323-ad30-b846fecdc9b5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:17.094922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:17.119648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8dc0a-0304-441c-81d0-1f8f8280f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:17.120299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8dc0a-0304-441c-81d0-1f8f8280f98f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:17.120580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8dc0a-0304-441c-81d0-1f8f8280f98f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:17.120854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8dc0a-0304-441c-81d0-1f8f8280f98f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:17.121700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8dc0a-0304-441c-81d0-1f8f8280f98f None admin] RBAC: Adding query filter params (group.id=34ebe1aa35994c24a6408479b646e810, role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=7ffb94c3eb4e4540b84c4cb9fb570f96) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:17.122015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8dc0a-0304-441c-81d0-1f8f8280f98f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:17.124091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8dc0a-0304-441c-81d0-1f8f8280f98f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:17.129766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 223/455] 10.222.0.47 () {56 vars in 1376 bytes} [Thu Jun 30 13:06:16 2022] GET /identity/v3/role_assignments?group.id=34ebe1aa35994c24a6408479b646e810&scope.project.id=7ffb94c3eb4e4540b84c4cb9fb570f96&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:19.452992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dc126-46de-4e51-af42-abee4663b54f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:19.453559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dc126-46de-4e51-af42-abee4663b54f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:19.453559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dc126-46de-4e51-af42-abee4663b54f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:19.455256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 233/456] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:19.460136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37965f-387e-4cc1-9454-20dac486aac6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:19.460891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37965f-387e-4cc1-9454-20dac486aac6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:19.461338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37965f-387e-4cc1-9454-20dac486aac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:19.486423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5a37965f-387e-4cc1-9454-20dac486aac6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:19.487843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5a37965f-387e-4cc1-9454-20dac486aac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:19.583693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 224/457] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:19.621344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dc126-46de-4e51-af42-abee4663b54f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:19.664787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:19.682184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8071a-cabc-44c5-9586-ccdedfa491de None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:19.683153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8071a-cabc-44c5-9586-ccdedfa491de None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:19.683660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8071a-cabc-44c5-9586-ccdedfa491de None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:19.685500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 225/458] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:19.692049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d49ed8-b5bc-4d39-8946-667db95bbb9b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:19.692336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d49ed8-b5bc-4d39-8946-667db95bbb9b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:19.692844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d49ed8-b5bc-4d39-8946-667db95bbb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:19.730461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a0d49ed8-b5bc-4d39-8946-667db95bbb9b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:19.731927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a0d49ed8-b5bc-4d39-8946-667db95bbb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:19.740149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dc126-46de-4e51-af42-abee4663b54f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:19.809003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:19.809826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:19.810113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:19.810392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:19.824836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:19.826572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:19.842753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 226/459] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:19.844064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5851-1c76-40a7-bf74-37cb43869b0b None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:19.844508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5851-1c76-40a7-bf74-37cb43869b0b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:19.844921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5851-1c76-40a7-bf74-37cb43869b0b None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:19.846610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 227/460] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:19.851648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2904d1-918f-417d-8c06-4e4018acdfe1 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:19.852084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2904d1-918f-417d-8c06-4e4018acdfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:19.852502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2904d1-918f-417d-8c06-4e4018acdfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:19.853074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:19.854212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:19.855256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:19.855256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:19.855256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:19.855256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:19.857044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 234/461] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:19.863063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:19.871124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ae2904d1-918f-417d-8c06-4e4018acdfe1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:19.872355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ae2904d1-918f-417d-8c06-4e4018acdfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:19.949842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:19.957902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 228/462] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:19.959292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2904d1-918f-417d-8c06-4e4018acdfe1 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:19.990129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:20.004085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580855b-2330-4513-97d7-189a9e644ba8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.040208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.041329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.041848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.042322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.043312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:20.043838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.045979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.065033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 235/463] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:20.069305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2904d1-918f-417d-8c06-4e4018acdfe1 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.070700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:20.106827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.108303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.108684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.109163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.119942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.121551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:20.140864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:20.141852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:20.142764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:20.142764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:20.142764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:20.142764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:20.142764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 229/464] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:20.143663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:20.161857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:20.185877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293bee-d879-4158-a15c-fa8954cddec7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.222077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.223291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.223750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.224170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.235467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.237148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.252186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4edda-8876-4359-b665-ed807a8abfde None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:20.257851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:20.258776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:20.259653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:20.259653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:20.259653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:20.259653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:20.261280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 236/465] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:20.262278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:20.266946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:20.294299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.294956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.295790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.296066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.296875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.298344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.331871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 230/466] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:06:20 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:20.332930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:20.411927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156a3a2-36d9-44a0-8a07-e79fe4ee2251 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.423581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:20.461005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe402-692c-48e3-a8f8-3f79024acc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.463037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe402-692c-48e3-a8f8-3f79024acc51 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.463529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe402-692c-48e3-a8f8-3f79024acc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.464203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe402-692c-48e3-a8f8-3f79024acc51 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.465122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe402-692c-48e3-a8f8-3f79024acc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:20.465304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40711-7689-4ca7-911c-c041c07a18bd None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.466070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe402-692c-48e3-a8f8-3f79024acc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.469547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe402-692c-48e3-a8f8-3f79024acc51 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.487240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 237/467] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:20.492546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee462d2-3913-4c49-8cb8-6c9e40e72494 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.492546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee462d2-3913-4c49-8cb8-6c9e40e72494 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.492546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee462d2-3913-4c49-8cb8-6c9e40e72494 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.494642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 238/468] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:20.495511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee462d2-3913-4c49-8cb8-6c9e40e72494 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:20.512726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1171d1-2a42-4ec8-96d5-ee3fbc1b202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.513405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1171d1-2a42-4ec8-96d5-ee3fbc1b202b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.513747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1171d1-2a42-4ec8-96d5-ee3fbc1b202b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.514570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1171d1-2a42-4ec8-96d5-ee3fbc1b202b None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.515311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1171d1-2a42-4ec8-96d5-ee3fbc1b202b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:20.515628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1171d1-2a42-4ec8-96d5-ee3fbc1b202b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.517067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1171d1-2a42-4ec8-96d5-ee3fbc1b202b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.531526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 231/469] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:20.532880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae2f5b-4929-405f-bf03-05e023145a2a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.533174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae2f5b-4929-405f-bf03-05e023145a2a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.533485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae2f5b-4929-405f-bf03-05e023145a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.551481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ddae2f5b-4929-405f-bf03-05e023145a2a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:20.552681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ddae2f5b-4929-405f-bf03-05e023145a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:20.586818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:20.636486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee462d2-3913-4c49-8cb8-6c9e40e72494 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.646304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 232/470] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:20.647509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae2f5b-4929-405f-bf03-05e023145a2a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:20.696285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.697147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.697435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.697756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.698913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.700630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.725761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 239/471] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:06:20 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:20.733938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:20.735459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:20.784298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae2f5b-4929-405f-bf03-05e023145a2a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.838545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.839878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.841887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.842971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.843992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.847319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:20.887489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 233/472] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:06:20 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:20.936879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b345-8d6f-4187-a5a1-8dc2f8a305dd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:20.959330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:20.979883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdecc-de22-4cac-8fcb-69e5b5760f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:20.981068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdecc-de22-4cac-8fcb-69e5b5760f8c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:20.981654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdecc-de22-4cac-8fcb-69e5b5760f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:20.982159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdecc-de22-4cac-8fcb-69e5b5760f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:20.994984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cdecc-de22-4cac-8fcb-69e5b5760f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:20.996878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cdecc-de22-4cac-8fcb-69e5b5760f8c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e00cdecc-de22-4cac-8fcb-69e5b5760f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:21.018650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:21.019661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:21.020500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:21.020500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:21.020500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:21.020500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:21.023018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 240/473] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:21.028454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:21.140763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5570fa-14d2-4b75-827b-270437a413db None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:21.158939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3022c2-b493-4384-b5ab-e10ef8b8138e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:21.159146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:21.159875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3022c2-b493-4384-b5ab-e10ef8b8138e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:21.160060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3022c2-b493-4384-b5ab-e10ef8b8138e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:21.164871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 241/474] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:21.171640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403c38d-9320-480e-92da-68d3c76b619e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:21.171927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403c38d-9320-480e-92da-68d3c76b619e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:21.172208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403c38d-9320-480e-92da-68d3c76b619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:21.182189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:21.182852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:21.183129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:21.183401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:21.184126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:21.184430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:21.186373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:21.197437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1403c38d-9320-480e-92da-68d3c76b619e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:21.198662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1403c38d-9320-480e-92da-68d3c76b619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:21.200068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 234/475] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:21.207086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:21.289775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 242/476] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:21.318985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403c38d-9320-480e-92da-68d3c76b619e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:21.332192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cd684-70a4-4905-9c37-ca4820f3f9e8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:21.388528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:21.389744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:21.390250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:21.390752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:21.391723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:21.393404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:21.426318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 235/477] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:06:21 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:06:21.454748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:21.459604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403c38d-9320-480e-92da-68d3c76b619e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:21.506692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:21.508405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:21.508910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:21.509434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:21.510428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:21.512069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:21.527268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.sql.core [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 13:06:21.527268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 13:06:21.527268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [parameters: {'id': '7d3cf80c1729466aa65313657b8d04a5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 13:06:21.527268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80037) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application conn.query(q) Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result.read() Jun 30 13:06:21.547497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return ref.to_dict() Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 13:06:21.548449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application next(self.gen) Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application yield resource Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application next(self.gen) Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise self.value Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application session.commit() Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 13:06:21.549358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.session.flush() Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application compat.raise_( Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 13:06:21.550268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 13:06:21.551175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application conn.query(q) Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result.read() Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 13:06:21.551987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [parameters: {'id': '7d3cf80c1729466aa65313657b8d04a5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:21.552775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 13:06:21.554959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:21.559095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 243/478] 10.222.0.47 () {60 vars in 1131 bytes} [Thu Jun 30 13:06:21 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:21.565301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:21.607453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:21.690353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04251-86bc-4a05-8118-f1e141149d8f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:21.730184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0d17a-1096-4970-8b06-7a78886e29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:21.731425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d17a-1096-4970-8b06-7a78886e29b5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:21.731915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d17a-1096-4970-8b06-7a78886e29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:21.732398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d17a-1096-4970-8b06-7a78886e29b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:21.745690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0d17a-1096-4970-8b06-7a78886e29b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-aed0d17a-1096-4970-8b06-7a78886e29b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:21.754452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:21.755393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 13:06:21.756278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:21.759096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 236/479] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:21.764615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:21.881486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9c52d-1999-400d-bedc-3758157db8e1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:21.917150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068dbe5-9165-484f-8303-c92e796fb318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:21.918169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dbe5-9165-484f-8303-c92e796fb318 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:21.918656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dbe5-9165-484f-8303-c92e796fb318 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:21.919150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dbe5-9165-484f-8303-c92e796fb318 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:21.920708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068dbe5-9165-484f-8303-c92e796fb318 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:21.921232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068dbe5-9165-484f-8303-c92e796fb318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:21.922843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068dbe5-9165-484f-8303-c92e796fb318 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:21.931465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 244/480] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:22.700867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625387-71f0-4c78-8e0a-72913674141a None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:22.702433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625387-71f0-4c78-8e0a-72913674141a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:22.702943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625387-71f0-4c78-8e0a-72913674141a None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:22.704779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 237/481] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:22.709802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7aa4c-c028-4c7d-ba0e-44e907b5ef82 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:22.710597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7aa4c-c028-4c7d-ba0e-44e907b5ef82 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:22.711090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7aa4c-c028-4c7d-ba0e-44e907b5ef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:22.731430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a5a7aa4c-c028-4c7d-ba0e-44e907b5ef82 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:22.732979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a5a7aa4c-c028-4c7d-ba0e-44e907b5ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:22.755039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:22.810518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 245/482] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:22.835729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625387-71f0-4c78-8e0a-72913674141a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:22.934244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:22.945975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625387-71f0-4c78-8e0a-72913674141a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:22.981256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:22.982101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:22.982383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:22.983186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:22.993536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:23.001882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:23.002804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:23.004260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 238/483] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:23.009086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7aa4c-c028-4c7d-ba0e-44e907b5ef82 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:23.115009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7aa4c-c028-4c7d-ba0e-44e907b5ef82 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:23.150686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:23.151363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.151651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.151930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.152679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:23.152988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:23.154923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:23.164028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 246/484] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:23.174535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:23.309557 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dac63-429f-4a3d-9504-26377909b310 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:23.362434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6966b-ec18-4408-8945-a968e61236ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:23.363228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6966b-ec18-4408-8945-a968e61236ad None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.363510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6966b-ec18-4408-8945-a968e61236ad None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.363784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6966b-ec18-4408-8945-a968e61236ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.385764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6966b-ec18-4408-8945-a968e61236ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:23.387236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6966b-ec18-4408-8945-a968e61236ad None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-46f6966b-ec18-4408-8945-a968e61236ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:23.414575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:23.415448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:23.416901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:23.416901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:23.416901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:23.416901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:23.416901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 239/485] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:23.422276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:23.461844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:23.498375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9120-ec6b-48f4-9d4f-6eabbf51483b None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.498683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9120-ec6b-48f4-9d4f-6eabbf51483b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.498944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9120-ec6b-48f4-9d4f-6eabbf51483b None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.500615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 240/486] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:23.505435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754a3dc-2aa8-438c-8f8b-e77900510efc None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.505750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754a3dc-2aa8-438c-8f8b-e77900510efc None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.506032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754a3dc-2aa8-438c-8f8b-e77900510efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.512852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:23.529129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5754a3dc-2aa8-438c-8f8b-e77900510efc None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:23.530980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5754a3dc-2aa8-438c-8f8b-e77900510efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:23.608056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0ed7-d41d-4ff5-b39a-8a9e8a9c884c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:23.659790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 241/487] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:23.660791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:23.661104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b85b3-be30-4136-be17-793ee10393de None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.661392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b85b3-be30-4136-be17-793ee10393de None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.661528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.661689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b85b3-be30-4136-be17-793ee10393de None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.661783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.662011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.662737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:23.663038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:23.664405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:23.676576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 242/488] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:23.678708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57170c-ba52-491d-a699-70fd1d8d6e85 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.678990 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57170c-ba52-491d-a699-70fd1d8d6e85 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.679263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57170c-ba52-491d-a699-70fd1d8d6e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.692995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 247/489] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:23.693870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:23.703679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0a57170c-ba52-491d-a699-70fd1d8d6e85 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:23.704846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0a57170c-ba52-491d-a699-70fd1d8d6e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:23.788830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:23.790360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 243/490] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:23.791377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57170c-ba52-491d-a699-70fd1d8d6e85 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:23.833582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaafc2e-7931-47d6-8334-14b3914ed824 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:23.865897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:23.868735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:23.869560 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.870041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.870318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.883968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:23.894637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:23.895530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:23.896433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:23.900867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 248/491] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:23.901727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:23.917312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57170c-ba52-491d-a699-70fd1d8d6e85 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:23.953756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:23.955068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:23.955576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:23.956088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:23.964015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:23.965747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:23.982424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:23.983398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:23.984306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:23.986884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 244/492] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:06:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:23.987958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.018048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35f46f-3c9f-47b8-9e0d-481a753d1691 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.051622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.052415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.052694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.052960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.063891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:24.071993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:24.072926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:24.073757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 249/493] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:24.079682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.093878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.099554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c343e-30e0-4ef4-9593-54f563cd59bb None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.127039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.140610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.141741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.142165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.142866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.143823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:24.144295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.146341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.158076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 245/494] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:24.159163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.208520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef3c1-4560-4f94-a92f-cd6ad7dc6406 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.256581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.257544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.257980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.258397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.259369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:24.259830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.261410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.281047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4804f-f849-4c3f-92f7-31454ec23a58 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.300556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 250/495] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:24.301712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.321289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfce0d-ea23-4e29-af9c-f12108d5e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.322040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfce0d-ea23-4e29-af9c-f12108d5e369 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.322326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfce0d-ea23-4e29-af9c-f12108d5e369 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.322602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfce0d-ea23-4e29-af9c-f12108d5e369 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.323713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfce0d-ea23-4e29-af9c-f12108d5e369 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:24.323837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfce0d-ea23-4e29-af9c-f12108d5e369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.325185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfce0d-ea23-4e29-af9c-f12108d5e369 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.338271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 246/496] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:24.338271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cbf6-df80-4b15-b7e0-5db8c4cd6e57 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.338271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cbf6-df80-4b15-b7e0-5db8c4cd6e57 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.339167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cbf6-df80-4b15-b7e0-5db8c4cd6e57 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.340365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 247/497] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:24.343235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20cbf6-df80-4b15-b7e0-5db8c4cd6e57 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.366296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.399650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.416148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf20257-b8b9-448d-a680-1dfb3978a4f5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.453547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.454340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.454623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.454896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.455182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20cbf6-df80-4b15-b7e0-5db8c4cd6e57 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.467154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.468665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:24.487112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:24.487996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:24.488837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:24.488837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:24.488837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:24.488837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:24.488837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 251/498] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:24.489105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.495876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.496526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.496805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.497078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.567318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.568751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.591814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e4fa-57f5-481b-adeb-cf6b4a41e08f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.600432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.615807 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.626011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb2ce-4609-4bae-a09a-ec341912bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.626791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb2ce-4609-4bae-a09a-ec341912bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.627068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb2ce-4609-4bae-a09a-ec341912bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.627347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb2ce-4609-4bae-a09a-ec341912bf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.638322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bb2ce-4609-4bae-a09a-ec341912bf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.639807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bb2ce-4609-4bae-a09a-ec341912bf7e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-824bb2ce-4609-4bae-a09a-ec341912bf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:24.657371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:24.658282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:24.659195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:24.659195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:24.659195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:24.659195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:24.659195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 252/499] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:24.659630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dac9aa-56de-481c-a612-c96251432487 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.659917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dac9aa-56de-481c-a612-c96251432487 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.660191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dac9aa-56de-481c-a612-c96251432487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.671090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 248/500] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:24.671866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.676501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-73dac9aa-56de-481c-a612-c96251432487 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:24.677706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-73dac9aa-56de-481c-a612-c96251432487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:24.744631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 253/501] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:24.746084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83578-804e-43aa-85e1-5baf90d5ee39 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.746374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83578-804e-43aa-85e1-5baf90d5ee39 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.746651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83578-804e-43aa-85e1-5baf90d5ee39 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.747935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 254/502] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:24.748679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d83578-804e-43aa-85e1-5baf90d5ee39 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.784467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cba27-0dd0-4ef4-b94c-afb663b7e80d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.817875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.818526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.818837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.819115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.819834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:24.820144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.821530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.832550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 249/503] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:24.833326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.839712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.846045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:24.851533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d83578-804e-43aa-85e1-5baf90d5ee39 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.885267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c1196-e5d8-4e6c-bb34-d35171866bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.885949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1196-e5d8-4e6c-bb34-d35171866bcd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.886230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1196-e5d8-4e6c-bb34-d35171866bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.886505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1196-e5d8-4e6c-bb34-d35171866bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.887221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c1196-e5d8-4e6c-bb34-d35171866bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:24.887524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c1196-e5d8-4e6c-bb34-d35171866bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.888922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c1196-e5d8-4e6c-bb34-d35171866bcd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.899823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 255/504] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:24.900980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddbf81-8315-42a7-8601-2df755edd920 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.901268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddbf81-8315-42a7-8601-2df755edd920 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.901574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddbf81-8315-42a7-8601-2df755edd920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.917509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d4ddbf81-8315-42a7-8601-2df755edd920 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:24.918630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d4ddbf81-8315-42a7-8601-2df755edd920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:24.932581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b0cde-c9b2-4d81-aa92-a499b726ab9d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:24.964679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:24.965453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:24.965754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:24.966026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:24.976662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:24.978127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:24.984522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 256/505] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:24.991456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddbf81-8315-42a7-8601-2df755edd920 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:24.995348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:24.996192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:24.997048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:24.997048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:24.997048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:24.997048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:24.997048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 250/506] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:24.997652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.059028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.075229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.096437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddbf81-8315-42a7-8601-2df755edd920 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.101740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda557eb-ded5-4b59-86bd-d77ab0e4a970 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.129473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.130274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.130552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.130826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.134206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.134986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.135268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.135544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.141259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:25.143454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.144859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:25.148898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:25.149886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:25.151003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 257/507] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:25.151824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:25.163798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:25.164752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:25.165689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 251/508] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:25.166530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.248456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92149-a4ac-4415-a2cf-7f4cfc1e0a9c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.265197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee441-380e-4d15-a9f1-549100b7fa8e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.281210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.282023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.282302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.282574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.284619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.289769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.291216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.293708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.299537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.300188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.300472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.300750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.301478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:25.301809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.303154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:25.307343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:25.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 258/509] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:25.309324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.319766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 252/510] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:25.319766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.410050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d69604-e3ac-41ac-82f1-aa21dcbb942b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.419531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846447f2-9604-4141-8426-325ffd9558e3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.442461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.443232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.443514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.443787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.453210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.453900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.454189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.454446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.455169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:25.455467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.455568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.456816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.456958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.464770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 253/511] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:25.469311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:25.474413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:25.475416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:25.476361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:25.476361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:25.476361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:25.476361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:25.476361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 259/512] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:25.476629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.508629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.529518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.568008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be0123-4118-4efc-b28c-d6bc5a2d680f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.581899 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec3bd0-fbd6-4968-a22a-39a77fd0fcff None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.603422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.604084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.604362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.604633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.605480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:25.605798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.607205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.615764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.616428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.616712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.616988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.617850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:25.618162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.619578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.637038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 260/513] 10.222.0.47 () {56 vars in 1137 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:25.637785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.655143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 254/514] 10.222.0.47 () {56 vars in 1137 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:25.655143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.737228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d500e8-4db3-4491-a215-6a582c8645bc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.747674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.750843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.753953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d741-4653-449b-97be-580ba6cfea1a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.773132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.773887 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.774175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.774452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.781056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.782548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.787464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.788248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.788536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.788813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:25.797726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:25.798559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:25.799416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 261/515] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:25.800472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.800580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.800651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:25.820143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:25.821162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:25.822580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:25.822580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:25.822580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:25.822580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:25.822580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 255/516] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:25.822580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.901680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a99b6-224e-4fce-ade2-878c6fbd39f4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.921874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952dfa-61ec-4613-b853-eed4951b3b9d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:25.934653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.935312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.935644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.936421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.937138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:25.937447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:25.938849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:25.950564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 262/517] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:25.951182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:25.958911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:25.959554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:25.959835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:25.960108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:25.981272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:25.981923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.028329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.029765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.052273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502b98-02d0-4a76-8b3c-de4defd939f7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.086096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.086767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.087046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.087355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.126952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 256/518] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:26.127582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.157051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.158546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.179644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.188690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.226207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e54436-638d-4bcc-aa94-26a165f36ae0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.258148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 263/519] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:26.258953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.259803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.260453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.260735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.261022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.262364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:26.262364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.263549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.281588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 257/520] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:26.282390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.356531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1dc3-af6f-459c-99dd-d9c6186c3b36 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.380176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebd76a-fcce-4877-9bfe-73fd1934d195 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.385143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.391503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.392161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.392443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.392720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.393438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:26.393776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.394337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.395151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.407633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 264/521] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:26.408342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.420982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.421656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.421938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.422212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.422911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.424333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.443112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 258/522] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:06:26 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:26.443893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.519791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee06a0-83bd-4cf4-9132-86caa9db1f33 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.558168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ee46-6042-4203-8369-c1c0db41bb61 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.560210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.561988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.562295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.562578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.576992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.578494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.599272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:26.599511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:26.600514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:26.601451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:26.601451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:26.601451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:26.601451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:26.601704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.601704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.601704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.601877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 265/523] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:26.601877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.615815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.617077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:26.636627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:26.637638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:26.638610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:26.638610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:26.638610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:26.638610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:26.640492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 259/524] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:26.642632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.653988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.676138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.715682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b380-fae6-4a1a-a16d-2266b1ddd1f7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.757180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.758214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.758738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.759026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.760501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=1fe6b95088494836b8598ea8f33d5167) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:26.760838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.762258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efb0a9-e9e4-4269-8416-deeb3f366663 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.762373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.769374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 266/525] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/role_assignments?user.id=1fe6b95088494836b8598ea8f33d5167&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:26.770464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.818030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.819126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.819484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.819838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.830635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.832310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:26.854657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:26.855643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 13:06:26.856605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:26.860748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 260/526] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:26.862325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.887413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cea761-922b-4438-b0d5-67b64f797fd3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:26.906427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.929198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:26.929918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:26.930199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:26.930476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:26.931214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:26.931518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:26.933526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:26.952840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 267/527] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:26.952840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:26.971298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:26.991969 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fc1c8-ac83-422a-aa6f-38d68d1f329a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.029421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.030115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.030397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.030674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.031397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:27.031763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.033215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.045936 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 261/528] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:27.046834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.085884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da244b-8c3c-4d23-aeba-23273a3af861 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.137834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.139467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.140021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.140301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.141377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:27.141718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.143913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.164563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9d7d6-abb9-4e47-8cb0-68d5e517215c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.166377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 268/529] 10.222.0.47 () {56 vars in 1139 bytes} [Thu Jun 30 13:06:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:27.168059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.199772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:27.210449 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.211692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.212886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.213362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.221889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.224174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.228118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:27.245780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:27.246849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:27.247912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:27.253941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 262/530] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:27.254814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.291483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be1b5b-c92e-4216-81e5-83ec613aaad4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.330026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.331071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.331501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.331931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.345513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.347171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.360440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5950f-6f04-49f2-b918-ffad340347bc None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:27.366516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:27.367538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:27.368479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:27.370628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 269/531] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:27.371684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.396544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.397282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.397703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.397974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.464611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:27.469746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:27.473341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.475385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.485618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2cd2c-d966-4929-b934-a8ce719667e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.522717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.523670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.524238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.524689 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.525761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:27.526276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.528015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.547921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 270/532] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:27.549149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.588229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 263/533] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:27.589349 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.661386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d19e1-4bc2-480b-8f5d-e0e16ce25016 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.696843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:27.699636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624ac72-c962-4715-b72d-16653fbe1619 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.700289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.701174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.702021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.702542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.703858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:27.704345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.706000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.719760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 271/534] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:27.720768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.724555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:27.740258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.741366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.741823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.742613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.743621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=71a850623f9b43f580dcdc7380ca9ede) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:27.744086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.746212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.754113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 264/535] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/role_assignments?user.id=71a850623f9b43f580dcdc7380ca9ede&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:27.755721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.850739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0e7d-0620-40f4-b38b-c2329e2f0749 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.889370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.890346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.890731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.891084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf68e66-ab36-4452-804b-97feb0dcb2e0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:27.891574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.907489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.909186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:27.928394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:27.929502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:27.930561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:27.930561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:27.930561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:27.930561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:27.932006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 272/536] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:27.940118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:27.940495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:27.942147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:27.944366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:27.944805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:27.945843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=ca9f55fa22844a31ba5bc9bff04ab67d) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:27.947415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:27.954523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:27.964740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 265/537] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/role_assignments?user.id=ca9f55fa22844a31ba5bc9bff04ab67d&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:28.019818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:28.080089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cd1e9-8959-46e9-855f-e4231b9b668e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:28.124743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:28.125718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:28.126181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:28.126603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:28.127512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:28.127967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:28.129516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:28.150168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 273/538] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:28.158697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:28.205478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:28.301352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c01ce-4980-459b-9cdc-2ee507a442e6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:28.342192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:28.343066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:28.343849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:28.344125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:28.359918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:28.361381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:28.378685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:28.379732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:28.380769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 266/539] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:28.386117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:28.522605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547f925-9a11-41dc-a8b8-8efe65a83b14 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:28.544466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:28.570361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde215-4e54-4101-8507-6973b2f8a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:28.571650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde215-4e54-4101-8507-6973b2f8a674 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:28.572137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde215-4e54-4101-8507-6973b2f8a674 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:28.572561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde215-4e54-4101-8507-6973b2f8a674 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:28.573512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde215-4e54-4101-8507-6973b2f8a674 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:28.573985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde215-4e54-4101-8507-6973b2f8a674 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:28.575566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde215-4e54-4101-8507-6973b2f8a674 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:28.593218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 274/540] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:28.599033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:28.730323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:28.744438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d094c3-5c9c-4685-9208-dc86fd9363fc None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:28.783623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6b0f6-1b10-4c30-9d7b-23ccecfbc75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:28.784203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6b0f6-1b10-4c30-9d7b-23ccecfbc75e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:28.784482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6b0f6-1b10-4c30-9d7b-23ccecfbc75e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:28.784753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6b0f6-1b10-4c30-9d7b-23ccecfbc75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:28.785607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6b0f6-1b10-4c30-9d7b-23ccecfbc75e None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=98a5a31ddbe04b2490689adcbe76f9b3) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:28.785920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6b0f6-1b10-4c30-9d7b-23ccecfbc75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:28.787340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6b0f6-1b10-4c30-9d7b-23ccecfbc75e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:28.796629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 267/541] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:28 2022] GET /identity/v3/role_assignments?user.id=98a5a31ddbe04b2490689adcbe76f9b3&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:28.801726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eadff-f85b-442b-8cc9-d110b4fd7d09 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:28.802021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eadff-f85b-442b-8cc9-d110b4fd7d09 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:28.802308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eadff-f85b-442b-8cc9-d110b4fd7d09 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:28.805122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 275/542] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:28.809830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d1a1-8c7a-4448-825b-4a3f763887eb None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:28.810118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d1a1-8c7a-4448-825b-4a3f763887eb None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:28.810399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d1a1-8c7a-4448-825b-4a3f763887eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:28.833107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-1540d1a1-8c7a-4448-825b-4a3f763887eb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:28.834350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1540d1a1-8c7a-4448-825b-4a3f763887eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:28.939310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 268/543] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:28.973594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eadff-f85b-442b-8cc9-d110b4fd7d09 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:29.132934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eadff-f85b-442b-8cc9-d110b4fd7d09 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:29.176559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635dcdd-96b4-475d-b1f1-3aa0cda72729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:29.177760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635dcdd-96b4-475d-b1f1-3aa0cda72729 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:29.178249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635dcdd-96b4-475d-b1f1-3aa0cda72729 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:29.178720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635dcdd-96b4-475d-b1f1-3aa0cda72729 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:29.198381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635dcdd-96b4-475d-b1f1-3aa0cda72729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8635dcdd-96b4-475d-b1f1-3aa0cda72729 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:29.206402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:29.207256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:29.208046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:29.210645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 276/544] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:29.216538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540d1a1-8c7a-4448-825b-4a3f763887eb None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:29.332306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:29.359796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540d1a1-8c7a-4448-825b-4a3f763887eb None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:29.412191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2fed-bf66-40a0-af8c-249ad2fd7897 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:29.412468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2fed-bf66-40a0-af8c-249ad2fd7897 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:29.412678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2fed-bf66-40a0-af8c-249ad2fd7897 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:29.414248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 277/545] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:29.414702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:29.415371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:29.415655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:29.416026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:29.416681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:29.416985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:29.418402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:29.423652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395da6-6098-418f-84c7-580f4c56b5bc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:29.425799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395da6-6098-418f-84c7-580f4c56b5bc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:29.426280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395da6-6098-418f-84c7-580f4c56b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:29.435605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 269/546] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:29.445486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:29.461427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f6395da6-6098-418f-84c7-580f4c56b5bc None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:29.462674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f6395da6-6098-418f-84c7-580f4c56b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:29.531054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:29.613419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 278/547] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:29.625489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7673b-0004-4ec1-8885-e580115af906 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:29.648250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395da6-6098-418f-84c7-580f4c56b5bc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:29.692313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:29.693041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:29.693325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:29.693644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:29.723434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:29.724900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:29.734763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:29.756362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395da6-6098-418f-84c7-580f4c56b5bc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:29.769551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:29.770400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:29.771242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:29.771242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:29.771242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:29.771242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:29.771242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 270/548] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:29.787843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:29.796941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:29.797783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:29.798065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:29.798347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:29.809678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:29.823225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:29.824103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:29.825420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:29.831839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 279/549] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:29.832963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:29.889800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:29.969256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd03f-9eeb-4c9f-9ae5-d5a789844cee None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.005374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.006889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.007175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.007453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.008176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:30.008485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.009932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.027525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14650-8462-4376-8a6d-d2111f07a1a4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.040771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 271/550] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:30.046569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.103946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.105020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.105527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.106062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.106999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:30.110918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.111552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.113315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.128848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 280/551] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:30.134472 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.158510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca516c1-b48c-4130-8a1d-0bad63fe8409 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.198559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538229ba-6fe2-4ab8-8aaa-5d5f78a049f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.199348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538229ba-6fe2-4ab8-8aaa-5d5f78a049f0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.199627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538229ba-6fe2-4ab8-8aaa-5d5f78a049f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.199898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538229ba-6fe2-4ab8-8aaa-5d5f78a049f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.208277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538229ba-6fe2-4ab8-8aaa-5d5f78a049f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.210054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538229ba-6fe2-4ab8-8aaa-5d5f78a049f0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-538229ba-6fe2-4ab8-8aaa-5d5f78a049f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:30.226246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:30.227260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:30.228284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 272/552] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:30.229339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897687-5897-4aad-9e63-597b9225fd9d None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.229339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897687-5897-4aad-9e63-597b9225fd9d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.229653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897687-5897-4aad-9e63-597b9225fd9d None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.231210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 273/553] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:30.238267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897687-5897-4aad-9e63-597b9225fd9d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.264842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.281562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42f83-6982-4304-9e24-cd94075c94c7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.320924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84b457-91e6-4624-8d35-dbec8e0e240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.321920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b457-91e6-4624-8d35-dbec8e0e240b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.322206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b457-91e6-4624-8d35-dbec8e0e240b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.322479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b457-91e6-4624-8d35-dbec8e0e240b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.333832 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84b457-91e6-4624-8d35-dbec8e0e240b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.335283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84b457-91e6-4624-8d35-dbec8e0e240b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.359461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897687-5897-4aad-9e63-597b9225fd9d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0c84b457-91e6-4624-8d35-dbec8e0e240b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:30.362145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:30.363009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:30.363875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:30.363875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:30.363875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:30.363875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:30.366213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 281/554] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:30.367789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521f95-1494-4954-a1a1-0718939a0d73 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.368280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521f95-1494-4954-a1a1-0718939a0d73 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.368757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521f95-1494-4954-a1a1-0718939a0d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.379051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.387421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-73521f95-1494-4954-a1a1-0718939a0d73 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:30.389067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-73521f95-1494-4954-a1a1-0718939a0d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:30.404350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.405192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.405495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.405783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.407097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:30.407453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.409169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.430969 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 274/555] 10.222.0.47 () {56 vars in 1135 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:30.432136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.485573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 282/556] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:30.485573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521f95-1494-4954-a1a1-0718939a0d73 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.553301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1357-bfaa-4056-95a2-1cb22c27a829 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.556810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.589777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521f95-1494-4954-a1a1-0718939a0d73 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.590306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4826f-5bb1-4f3e-9f88-eefb62244bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.590971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4826f-5bb1-4f3e-9f88-eefb62244bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.591249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4826f-5bb1-4f3e-9f88-eefb62244bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.591541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4826f-5bb1-4f3e-9f88-eefb62244bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.592933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4826f-5bb1-4f3e-9f88-eefb62244bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:30.592933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4826f-5bb1-4f3e-9f88-eefb62244bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.594011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4826f-5bb1-4f3e-9f88-eefb62244bc7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.610877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 275/557] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:30.610877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4ba8-c1cf-4343-b975-67296ca79a80 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.610877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4ba8-c1cf-4343-b975-67296ca79a80 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.610877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4ba8-c1cf-4343-b975-67296ca79a80 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.610877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 276/558] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:30.610877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4ba8-c1cf-4343-b975-67296ca79a80 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.634770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf544f2-0f14-405a-8caa-a79b50a60bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.635423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf544f2-0f14-405a-8caa-a79b50a60bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.635735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf544f2-0f14-405a-8caa-a79b50a60bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.635977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf544f2-0f14-405a-8caa-a79b50a60bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.650012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.703939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf544f2-0f14-405a-8caa-a79b50a60bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.705408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf544f2-0f14-405a-8caa-a79b50a60bc4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.724651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4ba8-c1cf-4343-b975-67296ca79a80 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.761361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.762546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.763061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.763526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.772649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.775209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:30.783567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:30.784575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:30.785431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 277/559] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:30.786824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.816662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 283/560] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:30.816662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59922-9452-40ff-b4fc-8a2d5fa74c71 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.816662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59922-9452-40ff-b4fc-8a2d5fa74c71 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.816662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59922-9452-40ff-b4fc-8a2d5fa74c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.831664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-dab59922-9452-40ff-b4fc-8a2d5fa74c71 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:30.832842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dab59922-9452-40ff-b4fc-8a2d5fa74c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:30.892458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.899315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29686e-cf47-4389-a06d-1432a8c7b31e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:30.913485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 284/561] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:30.913485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab59922-9452-40ff-b4fc-8a2d5fa74c71 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:30.950577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:30.951396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:30.951670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:30.951945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:30.960371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:30.962020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:30.977703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:30.979070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 278/562] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:30.980047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.018199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.021668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab59922-9452-40ff-b4fc-8a2d5fa74c71 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.056181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.056854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.057140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.057420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.058205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:31.058514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.059892 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.067752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 285/563] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:31.068522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.088991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332920c-ad72-47e8-930f-c834552e197c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.121404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.122208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.122485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.122754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.133023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.134487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:31.151941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:31.152932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:31.153856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:31.153856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:31.153856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.153856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:31.153856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 279/564] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:31.154129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.163432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.170538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8728-5d28-46d0-9935-3e1382268c42 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.203885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71a16f-3963-4bb0-b677-59a32a5a1cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.204665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71a16f-3963-4bb0-b677-59a32a5a1cba None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.204943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71a16f-3963-4bb0-b677-59a32a5a1cba None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.205216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71a16f-3963-4bb0-b677-59a32a5a1cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.215408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71a16f-3963-4bb0-b677-59a32a5a1cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1e71a16f-3963-4bb0-b677-59a32a5a1cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:31.223558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:31.224485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:31.225325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 286/565] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:31.226548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ce11d-9e56-4e39-b339-d7d5f3a96ade None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.226548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ce11d-9e56-4e39-b339-d7d5f3a96ade None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.226548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ce11d-9e56-4e39-b339-d7d5f3a96ade None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.227841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 287/566] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:31.230138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ce11d-9e56-4e39-b339-d7d5f3a96ade None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.253523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4ff3-3ce2-493a-840a-4863b2c40957 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.254765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.287682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.288276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.288560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.288839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.289689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:31.289999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.291414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.308016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 280/567] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:31.308642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.337554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ce11d-9e56-4e39-b339-d7d5f3a96ade None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.371440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.372237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.372526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.373478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.373621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.383972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.385416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:31.402702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:31.403757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:31.409635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:31.409635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:31.409635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.409635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:31.409635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 288/568] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:31.409635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.417453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f14c-9140-4eaf-9a61-8ae405829e39 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.449986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4b768-aaf8-4b8b-8370-bd3828bae154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.450637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4b768-aaf8-4b8b-8370-bd3828bae154 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.450916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4b768-aaf8-4b8b-8370-bd3828bae154 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.451226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4b768-aaf8-4b8b-8370-bd3828bae154 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.452437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4b768-aaf8-4b8b-8370-bd3828bae154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:31.452742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4b768-aaf8-4b8b-8370-bd3828bae154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.454116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4b768-aaf8-4b8b-8370-bd3828bae154 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.465313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 281/569] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:31.466493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b0fa-72c0-4300-8dbb-5904fa9e2278 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.466809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b0fa-72c0-4300-8dbb-5904fa9e2278 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.467083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b0fa-72c0-4300-8dbb-5904fa9e2278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.477937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.483190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-dc93b0fa-72c0-4300-8dbb-5904fa9e2278 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:31.484361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-dc93b0fa-72c0-4300-8dbb-5904fa9e2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:31.502811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42b7a5-5c3c-412c-ab41-838d6e3cb397 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.539806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.540410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.540698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.540979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.541764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:31.542073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.543451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.548629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 282/570] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:31.551515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 289/571] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:31.552289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.554383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b0fa-72c0-4300-8dbb-5904fa9e2278 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.610620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.657999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b0fa-72c0-4300-8dbb-5904fa9e2278 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.661086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f4562-a268-4835-92f7-0ab150a15ea8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.693572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.693749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.694357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.694490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.694641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.694763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.694902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.694995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.695621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:31.695908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.697268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.699496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.706741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.708168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.710277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 290/572] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:31.711063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:31.732120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:31.733072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:31.734003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:31.734003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:31.734003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.734003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:31.734003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 283/573] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:31.734370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.814823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a46e54-b62d-491d-a903-c4044f2f6d2b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.830239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf8db8-8b4b-40ae-a741-e62c2fd107c8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.837227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.847724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.848502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.848783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.849064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.855564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.856990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.865384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:31.866184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:31.866468 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:31.866743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:31.871182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:31.872179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:31.873948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 291/574] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:31.874543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.879106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:31.880532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:31.897874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:31.898930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:31.900010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:31.900010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:31.900010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:31.900010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:31.900010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 284/575] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:31.900010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:31.931818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:31.975942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de4441-c0a9-437e-8e6e-3420f4647235 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:31.997395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f17f-2150-42f0-b2de-4af706a143ae None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.009622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.010404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.010686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.010954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.020802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:32.028491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:32.029496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:32.030337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 292/576] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:32.031090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.036891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.037703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.037998 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.038253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.045978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.047427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:32.062154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:32.063235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:06:32.064384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:32.068017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 285/577] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:32.068698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.086583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.135003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493ddb6-2c0e-4cfd-963d-180380f85a65 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.150986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.170756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.171415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.171600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da4bfc-18fb-40de-9204-8aa4b6ebd873 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.171700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.171960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.172674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:32.172981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.174374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.187973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 293/578] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:32.188773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.218771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.219429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.219714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.219993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.220774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:32.221086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.224076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.240519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 286/579] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:32.241332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.296546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476db7e6-1546-4210-adbd-02bee7e2881f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.318725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.330023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.330674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.330955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.331230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.331946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:32.332252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.333700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.341652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2f1c6-a233-449f-8162-2422f3004ec9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.345552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 294/580] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:32.346351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.377166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.377860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.378140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.378410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.379143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:32.379448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.380823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.382310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.389658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 287/581] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:32.390446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.447320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d734542-3a09-49b5-bb71-21cb83502c3a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.480896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.481583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.481870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.482154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.483553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:32.483865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.485289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.488163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e888f80-8c06-4423-89fc-19e0273dc01b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.501785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 295/582] 10.222.0.47 () {56 vars in 1137 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:32.502569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.521011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.521813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.522090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.522367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.528865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.530948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.533342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:32.546363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:32.547310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:32.548225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 288/583] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:32.549216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.600999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.608418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475076-8db4-4c47-a4bc-7fd24251dd5d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.641543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.642189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.642465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.642737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.643552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=2ecb9bd88bce4c4c8014471d79105772) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:32.643859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.645265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.645390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd44c53-54e9-4662-b8dd-2f9887c1b255 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.650651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 296/584] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/role_assignments?user.id=2ecb9bd88bce4c4c8014471d79105772&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:32.651425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.684263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.685079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.685355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.686202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.694908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.696386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:32.713393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:32.714735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:32.715666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 289/585] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:32.716253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.780641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a775cb-ea10-40e4-b193-313990280674 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.781725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.821483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.822278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.822559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.822833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.830869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2a2cf-9cd2-46c0-b429-49241c9223cc None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:32.833876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.834842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:32.852764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:32.853868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:32.860102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:32.860102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:32.860102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:32.860102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:32.860102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 297/586] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:32.860102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.871321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.875900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:32.877107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:32.877415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:32.877733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:32.888413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:32.890385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:32.908521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:32.909438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:32.910377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:32.910377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:32.910377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:32.910377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:32.910377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 290/587] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:32.910674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:32.969908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572724d-868b-4bfd-a391-cbfa439b4991 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.004785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.005446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.005767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.006044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.006822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:33.007146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.008561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.015984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e20482-fc7a-452d-9c59-0a7c13a95a1b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.024521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 298/588] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:33.024521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.032318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.057372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.058321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.058609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.059753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.060631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:33.060944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.062414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.088355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 291/589] 10.222.0.47 () {56 vars in 1137 bytes} [Thu Jun 30 13:06:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:33.089525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.096042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.128184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdb97d-988a-4a01-b690-81e4829a67e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.162061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.162709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.163000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.163280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.164006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:33.164319 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.165728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.178095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 299/590] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:33.178871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.202141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070b89-5606-404b-bf1f-ef1a0baa7796 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.244628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.245726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.246115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.246493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.247319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:33.247775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.249693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.264750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 292/591] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:33.265880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.285869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea921568-2263-4363-bcad-5be6e677e98b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.297950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.317304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.323519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.324409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.324694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.324970 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/1fe6b95088494836b8598ea8f33d5167/roles/459550c1127b4295b6ceedf2ebd8003c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.340939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=1fe6b95088494836b8598ea8f33d5167, role_id=459550c1127b4295b6ceedf2ebd8003c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.342995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.365495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 300/592] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:33 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/1fe6b95088494836b8598ea8f33d5167/roles/459550c1127b4295b6ceedf2ebd8003c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:33.365495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.392607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06753a74-f4ce-48ac-96b4-69e21525611a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.431211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.432140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.432500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.432846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.444722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.446323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:33.465492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:33.466630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:33.468290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:33.468290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:33.468290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:33.468290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:33.468877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 293/593] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:33.473277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.491078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c0b1e-5f06-46c8-b613-da45f62920cf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.536302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.537608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.538371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.539005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.548971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.550646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.563620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:33.567859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:33.569025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:33.570200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 301/594] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:33.570925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.589306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ccd24-5295-43f9-8939-90ebed46ae16 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.619974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.638223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.640067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.640506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.640930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.651657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.653150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:33.669390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:33.670556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 294/595] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:33.671586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.690073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6600-0271-465e-af57-b215c4b4fb1e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.728029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.729019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.729527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.729976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.730874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:33.731489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.733193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.746953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 302/596] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:33.748664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.783914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5aa7-4943-43c8-adf5-fc2ce9e0a495 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.820425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.821176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.821378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.821700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.822516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:33.822826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.824897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.843722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.847229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 295/597] 10.222.0.47 () {56 vars in 1139 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:33.848277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.854611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:33.857594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30d24-f65c-4b2d-9c5f-38a6d9ad0877 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.894425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.894763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.895047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.895378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:33.896221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:33.896545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:33.898241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:33.911292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 303/598] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:33.912209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:33.960051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a522c-c996-4e70-a886-12cab31c2735 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:33.996396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:33.997181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:33.997482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:33.997767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.005399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.007066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.016418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d04670-7643-468b-b0dc-e9d2bc521144 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:34.021883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:34.023135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:34.024024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:34.027879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 296/599] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:34.028672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:34.057064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:34.058194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.058657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.059174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.070792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.072576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:34.092188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:34.093148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:34.094106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:34.094106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:34.094106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:34.094106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:34.094917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:34.097209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 304/600] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:34.098699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:34.124032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:34.148748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92b3b-bd59-4624-8d29-577fdcadff41 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:34.186665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:34.187654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.187941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.188208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/71a850623f9b43f580dcdc7380ca9ede/roles/459550c1127b4295b6ceedf2ebd8003c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.207911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=71a850623f9b43f580dcdc7380ca9ede, role_id=459550c1127b4295b6ceedf2ebd8003c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.209650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.223797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 297/601] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:34 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/71a850623f9b43f580dcdc7380ca9ede/roles/459550c1127b4295b6ceedf2ebd8003c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:34.224767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:34.237321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44a95-b19e-4d64-b799-92656c3fe9e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:34.300055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:34.300739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.301022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.301292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.302136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:34.302447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.304001 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.331855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 305/602] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:34.346250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cb670-5c88-4d11-83d8-e039216bace3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:34.350898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:34.377822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:34.428777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:34.430172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.431008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.431649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.432809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:34.433285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.435346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.454003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 298/603] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:34.463208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:34.471845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:34.510584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df28f76-b1aa-4d06-b01f-fdefcad17e32 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:34.548198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:34.549346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.549493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.549762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/ca9f55fa22844a31ba5bc9bff04ab67d/roles/459550c1127b4295b6ceedf2ebd8003c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.569893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=ca9f55fa22844a31ba5bc9bff04ab67d, role_id=459550c1127b4295b6ceedf2ebd8003c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.569893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.593893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963039e0-8c6f-466c-a3a6-3c908280651c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:34.620759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 306/604] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:34 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/ca9f55fa22844a31ba5bc9bff04ab67d/roles/459550c1127b4295b6ceedf2ebd8003c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:06:34.639875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ef1b5-6f37-4536-900b-f5647434e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:34.640745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ef1b5-6f37-4536-900b-f5647434e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.641033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ef1b5-6f37-4536-900b-f5647434e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.641312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ef1b5-6f37-4536-900b-f5647434e0b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.648948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ef1b5-6f37-4536-900b-f5647434e0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.650536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ef1b5-6f37-4536-900b-f5647434e0b3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-740ef1b5-6f37-4536-900b-f5647434e0b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:34.667436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:34.668738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:34.669857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 299/605] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:34.676142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:34.825976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b6dde-7037-421a-aa97-1f10173cc886 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:34.851246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3351-4c0b-4973-80ce-4cfdc0b18988 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.851696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3351-4c0b-4973-80ce-4cfdc0b18988 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.851835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:34.852153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3351-4c0b-4973-80ce-4cfdc0b18988 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.853939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 300/606] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:34.861223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f59218-c645-4f9d-a03a-7fb3094de9a7 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.861637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f59218-c645-4f9d-a03a-7fb3094de9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.861917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f59218-c645-4f9d-a03a-7fb3094de9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.866329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:34.867068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:34.867423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:34.867771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:34.868635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:34.869017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:34.870653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:34.884997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 307/607] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:34.886034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-35f59218-c645-4f9d-a03a-7fb3094de9a7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:34.890713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-35f59218-c645-4f9d-a03a-7fb3094de9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:34.894102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:34.934575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:34.981073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 301/608] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:35.004193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f59218-c645-4f9d-a03a-7fb3094de9a7 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:35.073539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dc09f-d811-49e8-b5d9-28980c8505a0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:35.115836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:35.116989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:35.117435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:35.117867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/98a5a31ddbe04b2490689adcbe76f9b3/roles/459550c1127b4295b6ceedf2ebd8003c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:35.136403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=98a5a31ddbe04b2490689adcbe76f9b3, role_id=459550c1127b4295b6ceedf2ebd8003c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:35.138121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:35.172348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 308/609] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:34 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/98a5a31ddbe04b2490689adcbe76f9b3/roles/459550c1127b4295b6ceedf2ebd8003c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:35.202987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f59218-c645-4f9d-a03a-7fb3094de9a7 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:35.241655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:35.242446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:35.242727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:35.242996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:35.254465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:35.262535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:35.264417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:35.265745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 302/610] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:35.273169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:35.332616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:35.422190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d3fbb-5ec4-4f05-a02d-9b04d263a27b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:35.458487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:35.459165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:35.459451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:35.459730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:35.460478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:35.460785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:35.462196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:35.471160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 309/611] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:35.476533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:35.500902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:35.615047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7a49-b3c9-44db-bb62-4ada22adb646 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:35.663890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db43c6b-6e7f-415c-8876-e12f49d34a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:35.664689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43c6b-6e7f-415c-8876-e12f49d34a9a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:35.664973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43c6b-6e7f-415c-8876-e12f49d34a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:35.665247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43c6b-6e7f-415c-8876-e12f49d34a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:35.676971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db43c6b-6e7f-415c-8876-e12f49d34a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:35.678398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db43c6b-6e7f-415c-8876-e12f49d34a9a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-2db43c6b-6e7f-415c-8876-e12f49d34a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:35.697076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:35.698036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:35.698918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:35.698918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:35.698918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:35.698918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:35.699136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 303/612] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:35.704838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:35.818789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:35.826967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518cfb1-0bbb-4f4d-a1b5-6f839d542880 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:35.856687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6a4b4-703c-4aca-9605-161f98ffa68b None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:35.856972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6a4b4-703c-4aca-9605-161f98ffa68b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:35.857789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6a4b4-703c-4aca-9605-161f98ffa68b None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:35.859163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 304/613] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:35.865968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e98a-7449-4566-b310-3cd8e1bdb541 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:35.865968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e98a-7449-4566-b310-3cd8e1bdb541 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:35.865968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e98a-7449-4566-b310-3cd8e1bdb541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:35.874679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:35.875345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:35.875630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:35.875909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:35.876727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:35.877039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:35.878513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:35.893881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 310/614] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:35.896704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:35.902522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b314e98a-7449-4566-b310-3cd8e1bdb541 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:35.903807 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b314e98a-7449-4566-b310-3cd8e1bdb541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:36.019731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 305/615] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:36.047799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314e98a-7449-4566-b310-3cd8e1bdb541 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.050087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:36.098677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f283-4f9d-44db-b371-7a48bbf7e0a3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.159994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314e98a-7449-4566-b310-3cd8e1bdb541 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.190682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.191770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.192260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.192711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.197779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.198578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.198862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.199139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.208443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:36.210160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:36.210270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:36.219452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:36.220371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:36.221231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 306/616] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:36.229483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:36.238524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:36.239634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:36.240605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:36.251083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 311/617] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:36.258341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.289146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:36.300090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:36.351886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0136-8ade-43e1-a38a-fe3b44adb9b4 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.387430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.388161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.388455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.393486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.393486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:36.393486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:36.393486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:36.400985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 307/618] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:36.407410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.486460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdb81-ccf0-4a64-afa4-0874f95402f9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.517581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2871a-fcc4-41d3-b291-81e06cf2793c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.545933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:36.546574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.547418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.547855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.548433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.549496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:36.550020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:36.550709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.551518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.551836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.552181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.552460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:36.563451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:36.564951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:36.571211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 312/619] 10.222.0.47 () {56 vars in 1135 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:36.580474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:36.588096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:36.589368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:36.590297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:36.590297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:36.590297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:36.590297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:36.590297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 308/620] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:36.595780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.689857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:36.723304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8661-8b40-485a-bc2d-16c2737747d8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.726678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54921e20-cef0-4d18-b62d-c03cb90815d3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.761555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e5826-9f07-423f-b18c-3cfff52f4482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.761790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88925bf-48b8-4ff0-a860-4eadfad50d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.762474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88925bf-48b8-4ff0-a860-4eadfad50d2a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.762759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88925bf-48b8-4ff0-a860-4eadfad50d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.763033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88925bf-48b8-4ff0-a860-4eadfad50d2a None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.763514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5826-9f07-423f-b18c-3cfff52f4482 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.764334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88925bf-48b8-4ff0-a860-4eadfad50d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:36.764644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88925bf-48b8-4ff0-a860-4eadfad50d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:36.764952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5826-9f07-423f-b18c-3cfff52f4482 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.765413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5826-9f07-423f-b18c-3cfff52f4482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.766049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88925bf-48b8-4ff0-a860-4eadfad50d2a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:36.777232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e5826-9f07-423f-b18c-3cfff52f4482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:36.778756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 309/621] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:36.779291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e5826-9f07-423f-b18c-3cfff52f4482 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:36.780343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608140-fc46-4056-a26e-37fda200f5d4 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.780637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608140-fc46-4056-a26e-37fda200f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.780918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608140-fc46-4056-a26e-37fda200f5d4 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.785739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 310/622] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:36.786529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608140-fc46-4056-a26e-37fda200f5d4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-147e5826-9f07-423f-b18c-3cfff52f4482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:36.799621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:36.800508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:36.801377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:36.801377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:36.801377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:36.801377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:36.803816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 313/623] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:36.805279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4440f9-eb10-4ed2-86e2-d872a5a42893 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.805801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4440f9-eb10-4ed2-86e2-d872a5a42893 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.806369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4440f9-eb10-4ed2-86e2-d872a5a42893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.825349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3d4440f9-eb10-4ed2-86e2-d872a5a42893 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:36.827577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3d4440f9-eb10-4ed2-86e2-d872a5a42893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:36.828038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:36.897451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608140-fc46-4056-a26e-37fda200f5d4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:36.902129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 314/624] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:36.903170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4440f9-eb10-4ed2-86e2-d872a5a42893 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:36.958471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:36.959254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:36.959540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:36.959817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:36.962124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:36.971616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:36.973339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:36.992445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:36.993410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:36.994387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 311/625] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:36.994983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.014294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4440f9-eb10-4ed2-86e2-d872a5a42893 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.050555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.051502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.051983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.052486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.053302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:37.053743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.055261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.067862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 315/626] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:37.068766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.128609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.138203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323d916-f43b-4e5b-8348-e0762366b1cf None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.174653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55ed39-2a19-4a08-a030-2df0809c89b4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.176239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.177532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.177532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.177710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.188849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:37.192799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:37.196696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:37.197740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 312/627] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:37.199408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.221694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecbd2b-3518-4aca-8cdc-b65c58f90955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.222357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecbd2b-3518-4aca-8cdc-b65c58f90955 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.222649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecbd2b-3518-4aca-8cdc-b65c58f90955 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.222929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecbd2b-3518-4aca-8cdc-b65c58f90955 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.223772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecbd2b-3518-4aca-8cdc-b65c58f90955 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:37.224084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecbd2b-3518-4aca-8cdc-b65c58f90955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.225526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecbd2b-3518-4aca-8cdc-b65c58f90955 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.243521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 316/628] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:37.244863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067f451-344f-452e-a1b0-d42ecb252611 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.245154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067f451-344f-452e-a1b0-d42ecb252611 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.245431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067f451-344f-452e-a1b0-d42ecb252611 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.246848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 317/629] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:37.247441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067f451-344f-452e-a1b0-d42ecb252611 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.318746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4950-1ebd-408b-afd5-c5a5195af630 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.353252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.354079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.354364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.354643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.362160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.363624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.364510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067f451-344f-452e-a1b0-d42ecb252611 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:37.378713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:37.379654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:37.380558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 313/630] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:37.381054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.400068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.408636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a17944-596c-4929-b979-da92e85bc053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.409429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a17944-596c-4929-b979-da92e85bc053 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.409737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a17944-596c-4929-b979-da92e85bc053 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.410041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a17944-596c-4929-b979-da92e85bc053 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.410750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a17944-596c-4929-b979-da92e85bc053 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:37.411051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a17944-596c-4929-b979-da92e85bc053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.412409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a17944-596c-4929-b979-da92e85bc053 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.425293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 318/631] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:37.425293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2c98d-c584-42cd-843e-bc1e7348a5ff None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.425293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2c98d-c584-42cd-843e-bc1e7348a5ff None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.425293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2c98d-c584-42cd-843e-bc1e7348a5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.441318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b5b2c98d-c584-42cd-843e-bc1e7348a5ff None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:37.442528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b5b2c98d-c584-42cd-843e-bc1e7348a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:37.470555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.493173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e4d46-fef7-4627-b5c1-bbfb0dd15bd5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.513738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 319/632] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:37.514787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2c98d-c584-42cd-843e-bc1e7348a5ff None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.541562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.542589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.542878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.543174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.618603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.620108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.638492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.641934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2c98d-c584-42cd-843e-bc1e7348a5ff None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.678736 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.679401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.679679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.679960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.680753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:37.681063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.682546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.699614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 320/633] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:37.699614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.723882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.740718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 314/634] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:37.741803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.806326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88146c90-df08-40bd-baf7-5560704b039b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.837635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b02b8-75c1-4d77-aa60-5c341f5f60c2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.838875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.839660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.839939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.840214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.851132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.852580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.854551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:37.869501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:37.870406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:37.871289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:37.871289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:37.871289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:37.871289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:37.871289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 321/635] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:37.871568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.876884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.877718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.877998 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.878269 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.889041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:37.896712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:37.897671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:37.898528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 315/636] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:37.899219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.949017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.972981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530a8ed-86b9-47a7-9000-1bde08520176 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.998852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8b470-b813-4f0c-9514-c6a0942e074b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.006050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2f5f-fd6e-454f-bfc3-894d179fa283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.006938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2f5f-fd6e-454f-bfc3-894d179fa283 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.007219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2f5f-fd6e-454f-bfc3-894d179fa283 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.007488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2f5f-fd6e-454f-bfc3-894d179fa283 None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/2ecb9bd88bce4c4c8014471d79105772/roles/459550c1127b4295b6ceedf2ebd8003c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.021885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c2f5f-fd6e-454f-bfc3-894d179fa283 None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=2ecb9bd88bce4c4c8014471d79105772, role_id=459550c1127b4295b6ceedf2ebd8003c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.023329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c2f5f-fd6e-454f-bfc3-894d179fa283 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.032737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.033535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.033816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.034084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.036445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 322/637] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:37 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/2ecb9bd88bce4c4c8014471d79105772/roles/459550c1127b4295b6ceedf2ebd8003c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:38.037439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc872df4-e855-46bb-acfe-7bc745dcb151 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.037770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc872df4-e855-46bb-acfe-7bc745dcb151 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.038050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc872df4-e855-46bb-acfe-7bc745dcb151 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.039324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 323/638] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:38.040043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc872df4-e855-46bb-acfe-7bc745dcb151 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.057703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.059205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:38.084192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:38.091085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:38.092748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:38.092748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:38.092748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:38.092748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:38.092748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 316/639] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:38.092748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.127582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.164974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc872df4-e855-46bb-acfe-7bc745dcb151 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.198824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.211427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd203-7fd1-4769-bf88-c607062570d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.212095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd203-7fd1-4769-bf88-c607062570d3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.212377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd203-7fd1-4769-bf88-c607062570d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.212643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd203-7fd1-4769-bf88-c607062570d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.213438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd203-7fd1-4769-bf88-c607062570d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:38.214073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd203-7fd1-4769-bf88-c607062570d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.215391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd203-7fd1-4769-bf88-c607062570d3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.216282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612bc1-7d7d-4965-98f8-682a3f62bb65 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.230860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 324/640] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:38.230860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2f98-b78a-40dc-8832-ba088c210c1c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.230860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2f98-b78a-40dc-8832-ba088c210c1c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.230860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2f98-b78a-40dc-8832-ba088c210c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.249283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2d0f2f98-b78a-40dc-8832-ba088c210c1c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:38.250641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2d0f2f98-b78a-40dc-8832-ba088c210c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:38.255575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.256247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.256532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.256839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.257591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:38.257904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.259271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.272390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 317/641] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:38.272390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.333527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 325/642] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:38.333527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f2f98-b78a-40dc-8832-ba088c210c1c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.381984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.393145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6a9e1-7b69-45f7-a35c-6a9777e7835d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.434469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.436195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.436482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.436756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.437494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:38.437801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.437960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f2f98-b78a-40dc-8832-ba088c210c1c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.439448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.458642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 318/643] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:38.458642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.459844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.475295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.476376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.476835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.477282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.485288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.486987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:38.502274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:38.503510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:06:38.504676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:38.505935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 326/644] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:38.506490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.568647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331521-b6bd-4598-bd70-b72188e8482a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.603000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.603774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.604051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.604319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.608969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3599e2-e85e-4245-9604-dbb702ec54dd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.614720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.616144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:38.633847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:38.634906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:38.636165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:38.636165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:38.636165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:38.636165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:38.637523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 319/645] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:38.638397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.644879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.650221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.651015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.651297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.651572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.663127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:38.671358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:38.672463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:38.673632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 327/646] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:38.674349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.710109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.754137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da75b2-5400-4ae5-826c-2f94b8312a5e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.780417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607b74c-319d-475e-897c-b0f68df64613 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.788609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.789405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.789705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.789971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.797172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.798627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:38.812669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:38.813729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 320/647] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:38.819351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.823845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.824516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.824803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.825084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.825958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:38.826270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.828113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.848611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 328/648] 10.222.0.47 () {56 vars in 1137 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:38.849380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.887915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.933719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f670d-0c71-4fd3-80bb-8f8b2d858fc2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.960612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:38.968365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.969021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.969121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66cf17-ff80-47ab-b6d7-d3a4b285d463 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.969300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.969616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.970330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:38.970787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.972903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.992034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 321/649] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:38.992034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.003990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.004749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.004927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.005206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.006229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:39.006348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.007659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.017321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 329/650] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:39.018222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.105816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302892bf-c1a1-4d95-9850-175a85b18002 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.126434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b31c-1e09-4243-98cf-58557843a1fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.130922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:39.143556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.144144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.144426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.144700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.145498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:39.145809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.147224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.160780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 322/651] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:39.161451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.166742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.167433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.167720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.167995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.195549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:39.241380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.242851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.269948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274cc21-abf6-4828-9264-137624bbcead None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.304746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.305558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.305839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.306281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.313529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.314956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:39.329522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:39.330489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 323/652] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:39.331451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.359023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 330/653] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:39.360020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.384315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:39.419426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:39.445824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974de17f-ecdc-46d2-afab-dea7ee98ff65 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.464816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114dc74-784e-406e-b901-479f338fee6f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.482067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.482989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.483388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.483662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.494354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.495789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.500538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.501392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.501849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.502272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.503268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=1fe6b95088494836b8598ea8f33d5167) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:39.503724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.505286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.511955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 331/654] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/role_assignments?user.id=1fe6b95088494836b8598ea8f33d5167&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:39.512741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:39.514180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:39.515095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:39.515095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:39.515095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:39.515095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:39.515095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 324/655] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:39.515572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.515688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.631161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:39.639098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf250a8-a722-4834-9aab-0d09ed93fa6d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.674651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd442a-ac98-4a0e-bb5a-3c53b4c9e2fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.680630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.680630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.680630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.680630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.692423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.693868 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.707207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:39.715447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:39.716381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:39.717290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:39.717290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:39.717290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:39.717290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:39.721212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 325/656] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:39.722096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.728983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.729916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.730346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.730769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.731764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:39.732080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.733578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.754617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 332/657] 10.222.0.47 () {56 vars in 1137 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:39.755462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.839187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e5e32-457d-4cbf-ad95-eaabccd7e865 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.870947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1d7f-fb51-4251-b0fc-107d045ded62 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:39.884603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.885589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.885950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.886305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.887560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:39.888134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.890423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.906428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 326/658] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:39.909897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.914752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:39.916258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:39.916543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:39.916820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:39.917593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:39.917951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:39.919385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:39.925887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:39.937554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 333/659] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:39.938536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:39.992009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.024372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5ca17-3b70-4a6b-be84-e2f18ecb58c6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.061702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92556-cf6c-4e21-9b2f-bb973dfc64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.062615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92556-cf6c-4e21-9b2f-bb973dfc64ec None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.063003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92556-cf6c-4e21-9b2f-bb973dfc64ec None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.063379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92556-cf6c-4e21-9b2f-bb973dfc64ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.070548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0636a0a-ece1-487e-b023-0d3400c17eeb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.118192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.119383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.120094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.120525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.130916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.132961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.139035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd92556-cf6c-4e21-9b2f-bb973dfc64ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.140495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd92556-cf6c-4e21-9b2f-bb973dfc64ec None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.148202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:40.151148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:40.152519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 334/660] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:40.153730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.252263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 327/661] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:40.253410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507773b-8482-4f2b-95aa-d88a62830a27 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.253729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507773b-8482-4f2b-95aa-d88a62830a27 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.254013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507773b-8482-4f2b-95aa-d88a62830a27 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.255301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 328/662] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:40.255995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507773b-8482-4f2b-95aa-d88a62830a27 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.265877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.270709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e58e3-c1e3-4715-bcef-5ed0ff1efbae None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.311777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.312570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.312878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.313158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.319933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.321373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:40.336693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:40.337773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:40.339041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:40.343420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 335/663] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:40.344299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.375177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507773b-8482-4f2b-95aa-d88a62830a27 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.383170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.412588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362df99-8e6d-4a98-98cc-f83a2b1722cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.413255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362df99-8e6d-4a98-98cc-f83a2b1722cd None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.413613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362df99-8e6d-4a98-98cc-f83a2b1722cd None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.413885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362df99-8e6d-4a98-98cc-f83a2b1722cd None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.414670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362df99-8e6d-4a98-98cc-f83a2b1722cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:40.415088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362df99-8e6d-4a98-98cc-f83a2b1722cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.416752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362df99-8e6d-4a98-98cc-f83a2b1722cd None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.435082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 329/664] 10.222.0.47 () {56 vars in 1139 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:40.441088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64228-0703-46d1-bbf7-b68fd788c774 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.441378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64228-0703-46d1-bbf7-b68fd788c774 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.441867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64228-0703-46d1-bbf7-b68fd788c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.447677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02815212-293f-4451-928a-8e71f3825b40 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.458441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-eab64228-0703-46d1-bbf7-b68fd788c774 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:40.459641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-eab64228-0703-46d1-bbf7-b68fd788c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:40.483897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.485221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.485545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.485830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.496265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.497729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:40.517037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:40.517988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:40.518898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:40.518898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:40.518898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:40.518898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:40.522696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 336/665] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:40.523544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.532090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 330/666] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:40.533214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64228-0703-46d1-bbf7-b68fd788c774 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.538149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.628649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.635896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64228-0703-46d1-bbf7-b68fd788c774 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.636105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415ecdc-b277-4077-a759-8f98bf63693a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.673249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.673947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.674237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.674519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.675174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.675305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:40.675604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.676330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.676813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.677030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.677498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.694157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 337/667] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:40.695003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.753641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.755100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.766809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.809177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ce033-7807-45c7-8844-77476ce9b941 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.845449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.846269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.846681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.847059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.847883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:40.848292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.849775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.853771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:40.867237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 331/668] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:40.867237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.867855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 338/669] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:40.869331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.967607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6c62-9d20-416b-bf41-4f3dd2dc32bd None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.972247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dea62-37b8-4d93-93d0-e22053857722 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.002663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:41.004600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.005490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.005823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.006057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.009379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.010174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.010554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.010933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.012040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=71a850623f9b43f580dcdc7380ca9ede) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:41.012457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.014325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.016421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:41.029395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 339/670] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/role_assignments?user.id=71a850623f9b43f580dcdc7380ca9ede&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:41.029395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:41.029707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:41.030794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 332/671] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:41.031829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.096916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:41.149728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5f45-c117-4e0f-8b6d-16b7221f1e8b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.150883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677dbc8-9277-4644-a4b5-b89c09a33996 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.188072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.189077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.189424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.189570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.189885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.190521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.190874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.191218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.198807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.200422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.202575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.204003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:41.217295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:41.218497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:41.219652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:41.221428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 340/672] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:41.222317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:41.223670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:41.224710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:41.225995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:41.225995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:41.225995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:41.225995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:41.225995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 333/673] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:41.229652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.303358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:41.364109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4618f4-37d3-43f5-a8c4-6818ebaaa503 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.366148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae4b8-a7f4-4455-be19-fc346918ebc5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.373903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:41.404993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.405877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.406267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.406645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.407839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:41.408248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.408994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.409856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.410009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.410431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.410853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.411955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:41.412424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.414402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.428515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 334/674] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:41.428515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.429116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 341/675] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:41.432709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.546189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfcc3d-d6af-4526-b338-368d706ecbf9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.552637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b956677-206e-4b25-8f7b-2fa025f063c1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.568183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:41.590691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.592287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.592790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.593243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.594280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=ca9f55fa22844a31ba5bc9bff04ab67d) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:41.594766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.596349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.597376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.598067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.598350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.598621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.599521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:41.599836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.601707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.604845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 342/676] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/role_assignments?user.id=ca9f55fa22844a31ba5bc9bff04ab67d&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:41.605977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.620137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 335/677] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:41.622579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.692870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:41.787803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c39ec-3b43-4e70-bcb6-a800c460b5d0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.802957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26018bef-ff81-4275-86dc-65183a50ab3f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.828289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbee826-01ea-49f8-87d0-4717dda201c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.829081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee826-01ea-49f8-87d0-4717dda201c8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.829360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee826-01ea-49f8-87d0-4717dda201c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.829656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee826-01ea-49f8-87d0-4717dda201c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.843735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee826-01ea-49f8-87d0-4717dda201c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.844181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf6b3d-9f1e-4c8e-af4d-e1bf01cfd94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.844982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6b3d-9f1e-4c8e-af4d-e1bf01cfd94d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.845185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee826-01ea-49f8-87d0-4717dda201c8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.845287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6b3d-9f1e-4c8e-af4d-e1bf01cfd94d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.845615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6b3d-9f1e-4c8e-af4d-e1bf01cfd94d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.853034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf6b3d-9f1e-4c8e-af4d-e1bf01cfd94d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.854854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf6b3d-9f1e-4c8e-af4d-e1bf01cfd94d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cfbee826-01ea-49f8-87d0-4717dda201c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:41.864029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:41.864953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:41.865911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:41.865911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:41.865911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:41.865911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:41.865911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 343/678] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:41.867035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfbb3-e872-4fd5-9347-6d5c68f98dbf None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.867320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfbb3-e872-4fd5-9347-6d5c68f98dbf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.867605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfbb3-e872-4fd5-9347-6d5c68f98dbf None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.868993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 344/679] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-edcf6b3d-9f1e-4c8e-af4d-e1bf01cfd94d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:41.874550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:41.875420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:41.877127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:41.878169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dfbb3-e872-4fd5-9347-6d5c68f98dbf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.878315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 336/680] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:41.878315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47f56-ac6f-472c-a0e3-8ff7e1920c86 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.878315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47f56-ac6f-472c-a0e3-8ff7e1920c86 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.878315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47f56-ac6f-472c-a0e3-8ff7e1920c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.898895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-16b47f56-ac6f-472c-a0e3-8ff7e1920c86 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:41.900091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-16b47f56-ac6f-472c-a0e3-8ff7e1920c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:41.917969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:41.988290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 337/681] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:41.988970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b47f56-ac6f-472c-a0e3-8ff7e1920c86 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.009413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.019263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dfbb3-e872-4fd5-9347-6d5c68f98dbf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.059721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.060937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.061221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.061514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.062233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:42.062579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.063984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.077725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 345/682] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:42.078701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.116383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b47f56-ac6f-472c-a0e3-8ff7e1920c86 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.156584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.157259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.157566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.157942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.158723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:42.159030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.160566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.173407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 338/683] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:42.174427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.189764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.201773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb148c3a-4dab-4194-b181-a371abe3308b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.244862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.245783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.246068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.246351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.258576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:42.266072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:42.268099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:42.269233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:42.270355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:42.272766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 346/684] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:42.273748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.296915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b174ad5-23d6-4792-9fe8-51a44004a701 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.334928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.335767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.336046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.336404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.345123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.346752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:42.364816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:42.366029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:42.367082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:42.370835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 339/685] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:42.371757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.390605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06004a-2045-4511-b81f-fc84542a221e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.434447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.436088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.436623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.437239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.438278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=98a5a31ddbe04b2490689adcbe76f9b3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:42.438856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.440546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.453614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 347/686] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/role_assignments?user.id=98a5a31ddbe04b2490689adcbe76f9b3&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:42.454843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.485304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74125-9c8e-4b4b-8c8c-ad10da448f16 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.486273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.525454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.526204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.526485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.526755 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.527695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:42.528002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.529489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.532265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.545759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 340/687] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:42.547090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.601548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292391a-5761-4445-bb1d-fbfcda4889ff None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.646795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.647773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.648223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.648757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.649928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:42.650416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.652182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.659574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26feb805-308a-4a39-954d-3858c5661137 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.673316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 348/688] 10.222.0.47 () {56 vars in 1135 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:42.682592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.716424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.718489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.718933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.719616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.734248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.736289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:42.760003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:42.761197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:42.762311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:42.762311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:42.762311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:42.762311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:42.764815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 341/689] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:42.771425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.785265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.819393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d85b2-4595-425d-9ef6-6c0d63859c69 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.834385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.868217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.868217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.868538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.868739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.907174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ce719-fe58-4fe6-af74-d875b9cda219 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.959131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.960069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.960519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.960963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.962034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:42.962606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.964389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.965076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.967496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.978935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 342/690] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:42.985083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.059363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:43.097570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 349/691] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:43.099012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.179582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d3ee-a4b1-4ea1-816a-51f637c86aac None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:43.205245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f3c1-9d0d-40c1-b4f9-c03c2435d2e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:43.208166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:43.243337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:43.244133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.244411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.244683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.252872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:43.254467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:43.271220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:43.272338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:43.273608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 343/692] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:43.280164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.299589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668946d-fa80-43c1-8804-39540fd02c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:43.300381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668946d-fa80-43c1-8804-39540fd02c82 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.300659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668946d-fa80-43c1-8804-39540fd02c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.300933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668946d-fa80-43c1-8804-39540fd02c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.316289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668946d-fa80-43c1-8804-39540fd02c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:43.317755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668946d-fa80-43c1-8804-39540fd02c82 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b668946d-fa80-43c1-8804-39540fd02c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:43.351799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:43.352898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:43.354558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:43.354558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:43.354558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:43.354558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:43.354558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 350/693] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:43.358957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2688ba-d62a-4469-9c37-4a51ea73f30a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.359250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2688ba-d62a-4469-9c37-4a51ea73f30a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.359530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2688ba-d62a-4469-9c37-4a51ea73f30a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.361002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 351/694] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:43.362207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2688ba-d62a-4469-9c37-4a51ea73f30a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.399927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:43.437653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689390-f62f-4773-93cc-cb4940e27ec5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:43.476228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9f91-ad07-4d29-8637-04122de1627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:43.477264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9f91-ad07-4d29-8637-04122de1627c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.477901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9f91-ad07-4d29-8637-04122de1627c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.478407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9f91-ad07-4d29-8637-04122de1627c None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.479542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9f91-ad07-4d29-8637-04122de1627c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:43.480089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9f91-ad07-4d29-8637-04122de1627c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:43.481871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9f91-ad07-4d29-8637-04122de1627c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:43.508943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2688ba-d62a-4469-9c37-4a51ea73f30a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:43.509415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 344/695] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:06:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:43.511374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c092b-f677-4c9c-91b7-82be673ba0ae None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.511896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c092b-f677-4c9c-91b7-82be673ba0ae None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.512403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c092b-f677-4c9c-91b7-82be673ba0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.529752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a40c092b-f677-4c9c-91b7-82be673ba0ae None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:43.531357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a40c092b-f677-4c9c-91b7-82be673ba0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:43.547975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:43.548653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.548941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.549222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.550267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:43.550579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:43.552229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:43.558852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:43.574952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 352/696] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:43.574952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.625492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 345/697] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:43.625492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c092b-f677-4c9c-91b7-82be673ba0ae None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.709098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:43.728336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1de91-dd66-4cd7-b110-d357d57d0ff8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:43.744316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c092b-f677-4c9c-91b7-82be673ba0ae None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:43.766061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:43.766629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.766912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.767185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.784032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:43.785167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.785712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.786339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.794151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:43.796561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:43.813143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:43.814128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:43.815024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:43.823126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 346/698] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:43.824285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.838054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:43.839766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:43.845798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:43.930478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:43.938783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbe030-faf0-42fd-a78f-3493c4747634 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:43.952262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 353/699] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:43.952262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:43.983446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:43.984884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:43.985502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:43.986022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:43.986693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:43.988065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:44.003182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:44.004284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:44.005189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:44.009978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 347/700] 10.222.0.47 () {56 vars in 1129 bytes} [Thu Jun 30 13:06:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:44.010608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.054894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe6524-6ab1-4a11-946d-0f6cec88b845 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.091372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b488c05-7b1d-48cf-ae5e-f63c045eab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.092055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c05-7b1d-48cf-ae5e-f63c045eab17 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.092337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c05-7b1d-48cf-ae5e-f63c045eab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.092755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c05-7b1d-48cf-ae5e-f63c045eab17 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.093565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c05-7b1d-48cf-ae5e-f63c045eab17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:44.093875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c05-7b1d-48cf-ae5e-f63c045eab17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.095367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c05-7b1d-48cf-ae5e-f63c045eab17 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.097310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.109415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 354/701] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:44.111000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c1b9-1486-4fc5-9fb4-6e99c3adc449 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.111366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c1b9-1486-4fc5-9fb4-6e99c3adc449 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.111721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c1b9-1486-4fc5-9fb4-6e99c3adc449 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.113163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 355/702] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:44.117402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99c1b9-1486-4fc5-9fb4-6e99c3adc449 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.127115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e661-7a9d-4bf2-9c33-50b249fc10b5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.162321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.165521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.166508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.166829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.167106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.179013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.180939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:44.197780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:44.198679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:44.199567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:44.199567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:44.199567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:44.199567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:44.199567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 348/703] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:44.199852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.224548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99c1b9-1486-4fc5-9fb4-6e99c3adc449 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.260820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e273f16-6de7-4d01-a536-bfa7a7c47135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.261495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e273f16-6de7-4d01-a536-bfa7a7c47135 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.261867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e273f16-6de7-4d01-a536-bfa7a7c47135 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.262132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e273f16-6de7-4d01-a536-bfa7a7c47135 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.262753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e273f16-6de7-4d01-a536-bfa7a7c47135 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:44.263064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e273f16-6de7-4d01-a536-bfa7a7c47135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.264453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e273f16-6de7-4d01-a536-bfa7a7c47135 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.268964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 356/704] 10.222.0.47 () {56 vars in 1124 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:44.269979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238873-1bd5-4c22-88ce-a8d0b4fffc6b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.270270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238873-1bd5-4c22-88ce-a8d0b4fffc6b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.270550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238873-1bd5-4c22-88ce-a8d0b4fffc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.287337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f1238873-1bd5-4c22-88ce-a8d0b4fffc6b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:44.288513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f1238873-1bd5-4c22-88ce-a8d0b4fffc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:44.307558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea881b-048e-4a45-b6f1-d95bbbc01c3c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.346000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.347514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.348030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.348785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.350107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=2ecb9bd88bce4c4c8014471d79105772) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:44.351042 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.353332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.356362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.362010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 357/705] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:44.362854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1238873-1bd5-4c22-88ce-a8d0b4fffc6b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.369812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 349/706] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/role_assignments?user.id=2ecb9bd88bce4c4c8014471d79105772&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:44.369812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.445012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.511413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b33a7-fd88-4c06-a6b0-117feda98557 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.517251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1238873-1bd5-4c22-88ce-a8d0b4fffc6b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.556579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.557238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.557551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.557878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.558532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:44.558838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.560237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.560496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.561390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.562125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.562609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.563535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:44.564369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.566262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.566917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 350/707] 10.222.0.47 () {56 vars in 1124 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:44.574957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.584161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 358/708] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:44.590072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.663403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.719814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865a862-3a80-4e13-affc-e1d474d88c79 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.735433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.739288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739827-2130-45ed-8631-0eb21eee7992 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.764008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.764801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.765078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.765524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.776985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.778629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.788639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.789796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.790308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.790787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:44.797209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:44.798184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:44.799094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:44.799094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:44.799094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:44.799094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:44.799094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 351/709] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:44.800894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.802400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.804235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:44.820562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:44.821519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:44.822847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 359/710] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:44.828010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.934533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21384-07ef-4f12-9ad6-4d95c42d0489 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.952049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.976415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198501-4929-4d46-b98e-c49ae6fe4586 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.979607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afe281-ccd6-4195-ae11-b033be8f0f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.980564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe281-ccd6-4195-ae11-b033be8f0f15 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.981055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe281-ccd6-4195-ae11-b033be8f0f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.981577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe281-ccd6-4195-ae11-b033be8f0f15 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.982572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afe281-ccd6-4195-ae11-b033be8f0f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:44.983096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afe281-ccd6-4195-ae11-b033be8f0f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.985216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afe281-ccd6-4195-ae11-b033be8f0f15 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.002800 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 352/711] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:45.004743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7171a-77d9-41a4-996d-10ec63d3a2ec None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.005563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7171a-77d9-41a4-996d-10ec63d3a2ec None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.006539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7171a-77d9-41a4-996d-10ec63d3a2ec None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.008785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 353/712] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:45.010487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7171a-77d9-41a4-996d-10ec63d3a2ec None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.015814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014df3ed-2c76-4909-a84e-0e28a6fe7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.015995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df3ed-2c76-4909-a84e-0e28a6fe7569 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.016218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df3ed-2c76-4909-a84e-0e28a6fe7569 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.016503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df3ed-2c76-4909-a84e-0e28a6fe7569 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.017309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014df3ed-2c76-4909-a84e-0e28a6fe7569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:45.017665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014df3ed-2c76-4909-a84e-0e28a6fe7569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.019103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014df3ed-2c76-4909-a84e-0e28a6fe7569 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.032438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 360/713] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:45.038185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b12a-180b-4319-a8ee-c38b21949903 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.038480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b12a-180b-4319-a8ee-c38b21949903 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.038761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b12a-180b-4319-a8ee-c38b21949903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.057909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0a83b12a-180b-4319-a8ee-c38b21949903 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:45.059213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0a83b12a-180b-4319-a8ee-c38b21949903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:45.077310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:45.142629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 361/714] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:45.144655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b12a-180b-4319-a8ee-c38b21949903 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.148060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7171a-77d9-41a4-996d-10ec63d3a2ec None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.194890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.195621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.195953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.196441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.196942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.198467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.223579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 354/715] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:06:45 2022] POST /identity/v3/users => generated 254 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:45.224435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.267144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b12a-180b-4319-a8ee-c38b21949903 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.268137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:45.364522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae2401-6ffc-4b7c-bf2d-7e7d4b9b3a7d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.366734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.367770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.368299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.368803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.369895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=1fe6b95088494836b8598ea8f33d5167) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:45.370422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.372268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.390346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 362/716] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/role_assignments?user.id=1fe6b95088494836b8598ea8f33d5167&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:45.412986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.413892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.414167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.414438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] PATH_INFO: `/v3/services/network` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.415117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.416643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:45.430303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:45.431384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:45.432459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 355/717] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:45.438267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.458282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:45.557136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cab66-ce92-4344-a64f-2e4b4e569d4b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.596290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976ad33-c0e3-4914-8c3d-1f4cf1fe7b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.597384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976ad33-c0e3-4914-8c3d-1f4cf1fe7b58 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.597967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976ad33-c0e3-4914-8c3d-1f4cf1fe7b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.598439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976ad33-c0e3-4914-8c3d-1f4cf1fe7b58 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.599337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976ad33-c0e3-4914-8c3d-1f4cf1fe7b58 None admin] RBAC: Adding query filter params (name=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:45.599841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976ad33-c0e3-4914-8c3d-1f4cf1fe7b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.601566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976ad33-c0e3-4914-8c3d-1f4cf1fe7b58 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.606732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 363/718] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:45.612243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.719400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:45.726500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737c286-3e0b-4058-9c5f-b0a02f074f92 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.766109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38870285-4ee9-4ad5-98ea-4a445139857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.766781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38870285-4ee9-4ad5-98ea-4a445139857b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.767063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38870285-4ee9-4ad5-98ea-4a445139857b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.767333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38870285-4ee9-4ad5-98ea-4a445139857b None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.768038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38870285-4ee9-4ad5-98ea-4a445139857b None admin] RBAC: Adding query filter params (type=network) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:45.768341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38870285-4ee9-4ad5-98ea-4a445139857b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.769735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38870285-4ee9-4ad5-98ea-4a445139857b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.774862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 356/719] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:46.920599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf88e2-aaf5-4bf7-a102-b9a9b8b45ab7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.921669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf88e2-aaf5-4bf7-a102-b9a9b8b45ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.922173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf88e2-aaf5-4bf7-a102-b9a9b8b45ab7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.924025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 364/720] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:46.928778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7718c3-6990-465c-8b8b-820145ad80e9 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.929197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7718c3-6990-465c-8b8b-820145ad80e9 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.929389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7718c3-6990-465c-8b8b-820145ad80e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.948767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-aa7718c3-6990-465c-8b8b-820145ad80e9 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:46.949974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-aa7718c3-6990-465c-8b8b-820145ad80e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:47.036932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 357/721] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:47.070454 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf7b0e-5881-45f7-8c79-ab3d0f6aeba0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.071062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf7b0e-5881-45f7-8c79-ab3d0f6aeba0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.071573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf7b0e-5881-45f7-8c79-ab3d0f6aeba0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.073198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7718c3-6990-465c-8b8b-820145ad80e9 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.073747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 365/722] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:47.093890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6a5c-6108-4811-8e37-c2939ceeef00 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.094720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6a5c-6108-4811-8e37-c2939ceeef00 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.095276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6a5c-6108-4811-8e37-c2939ceeef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.124004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-24cb6a5c-6108-4811-8e37-c2939ceeef00 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:47.125636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-24cb6a5c-6108-4811-8e37-c2939ceeef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:47.167159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:47.193334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7718c3-6990-465c-8b8b-820145ad80e9 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.247005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:47.247842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.248127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.248400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.270308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:47.277968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:47.279485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:47.280785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 358/723] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:47.286441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 366/724] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:47.287237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.308990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb6a5c-6108-4811-8e37-c2939ceeef00 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.321845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:47.457679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9449cf-895b-475c-9b22-c788feac271b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.499124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:47.499801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.500088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.500370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.501122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:47.501435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:47.502835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:47.524183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 359/725] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:47.536272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb6a5c-6108-4811-8e37-c2939ceeef00 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.541103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.554515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:47.650003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f75ff-404f-4e3f-97a8-4303b2a94869 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.670198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:47.670888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.671174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.671449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.672188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:47.673602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:47.687650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da44a15-8b33-44a7-a5c0-d3fae0ef4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:47.688690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44a15-8b33-44a7-a5c0-d3fae0ef4164 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.689139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44a15-8b33-44a7-a5c0-d3fae0ef4164 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.689635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44a15-8b33-44a7-a5c0-d3fae0ef4164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.703101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da44a15-8b33-44a7-a5c0-d3fae0ef4164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:47.704816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da44a15-8b33-44a7-a5c0-d3fae0ef4164 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:47.724433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 367/726] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:06:47 2022] POST /identity/v3/services => generated 251 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-3da44a15-8b33-44a7-a5c0-d3fae0ef4164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:47.727667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:47.728746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:47.729909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:47.729909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:47.729909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:47.729909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:47.731980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 360/727] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:47.737860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.812682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d16d-65ac-4c8d-8e72-fa637fc4cfd8 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.813211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d16d-65ac-4c8d-8e72-fa637fc4cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.813773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d16d-65ac-4c8d-8e72-fa637fc4cfd8 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.815740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 361/728] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:47.821504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b3293-45b8-442f-856d-47dc7b20121c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.822118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b3293-45b8-442f-856d-47dc7b20121c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.822549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b3293-45b8-442f-856d-47dc7b20121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.842502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-991b3293-45b8-442f-856d-47dc7b20121c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:47.844108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-991b3293-45b8-442f-856d-47dc7b20121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:47.850666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:47.914675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:47.939287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 362/729] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 13:06:47.950409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8857d2-9ff2-4319-967a-f25cef5f99a1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.966458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b3293-45b8-442f-856d-47dc7b20121c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.026918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba356d-e911-4482-b534-974e1594acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.027596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba356d-e911-4482-b534-974e1594acce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.027881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba356d-e911-4482-b534-974e1594acce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.028159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba356d-e911-4482-b534-974e1594acce None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.028939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba356d-e911-4482-b534-974e1594acce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:48.029323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba356d-e911-4482-b534-974e1594acce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:48.030916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba356d-e911-4482-b534-974e1594acce None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:48.047207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 368/730] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:48.053207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba356d-e911-4482-b534-974e1594acce None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.091663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b3293-45b8-442f-856d-47dc7b20121c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.129107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7317ff-a7da-41c6-8dd6-e56fc254a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.129937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7317ff-a7da-41c6-8dd6-e56fc254a078 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.130222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7317ff-a7da-41c6-8dd6-e56fc254a078 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.130500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7317ff-a7da-41c6-8dd6-e56fc254a078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.141595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7317ff-a7da-41c6-8dd6-e56fc254a078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-3a7317ff-a7da-41c6-8dd6-e56fc254a078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:48.149194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:48.150178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 363/731] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:48.152087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233df9-fc65-4424-8902-a532259039d0 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.152855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233df9-fc65-4424-8902-a532259039d0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.152855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233df9-fc65-4424-8902-a532259039d0 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.154139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 364/732] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:48.159381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233df9-fc65-4424-8902-a532259039d0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.182395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba356d-e911-4482-b534-974e1594acce None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.211582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:48.220610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:48.226126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccac3a-a9ce-4e5d-acb4-502c4f43062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.227333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccac3a-a9ce-4e5d-acb4-502c4f43062f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.227873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccac3a-a9ce-4e5d-acb4-502c4f43062f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.228348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccac3a-a9ce-4e5d-acb4-502c4f43062f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.237100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccac3a-a9ce-4e5d-acb4-502c4f43062f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:48.238918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccac3a-a9ce-4e5d-acb4-502c4f43062f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-94ccac3a-a9ce-4e5d-acb4-502c4f43062f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:48.258163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:48.259295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:48.260404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:48.268127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 369/733] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:48.268127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4fcc8-30c9-461b-8908-77ed7f4504fe None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.268127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4fcc8-30c9-461b-8908-77ed7f4504fe None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.268127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4fcc8-30c9-461b-8908-77ed7f4504fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.284863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233df9-fc65-4424-8902-a532259039d0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.290069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-14e4fcc8-30c9-461b-8908-77ed7f4504fe None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:48.291510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-14e4fcc8-30c9-461b-8908-77ed7f4504fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:48.326246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.326917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.327201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.327479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.328228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:48.328538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:48.329958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:48.339424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 365/734] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:48.340274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.386991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 370/735] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:48.388635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8292a81-778a-49cc-b917-e869c156a5b9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.388916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8292a81-778a-49cc-b917-e869c156a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.389193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8292a81-778a-49cc-b917-e869c156a5b9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.391006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 371/736] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:48.391602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8292a81-778a-49cc-b917-e869c156a5b9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.450403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e6a70-a261-4e04-80be-5a3021677e02 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.461198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:48.485732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1d34-358c-4883-9451-5b581d1ffbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.486405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1d34-358c-4883-9451-5b581d1ffbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.487354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1d34-358c-4883-9451-5b581d1ffbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.487354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1d34-358c-4883-9451-5b581d1ffbc3 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.487790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1d34-358c-4883-9451-5b581d1ffbc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:48.488111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1d34-358c-4883-9451-5b581d1ffbc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:48.489558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1d34-358c-4883-9451-5b581d1ffbc3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:48.507828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 366/737] 10.222.0.47 () {56 vars in 1135 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:48.508860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac12b-d70c-43d0-b100-ed59703b2262 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.509152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac12b-d70c-43d0-b100-ed59703b2262 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.509432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac12b-d70c-43d0-b100-ed59703b2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.520076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8292a81-778a-49cc-b917-e869c156a5b9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.526543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e5bac12b-d70c-43d0-b100-ed59703b2262 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:48.528018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e5bac12b-d70c-43d0-b100-ed59703b2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:48.534005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:48.562522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.563235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.563517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.563792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.575016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:48.576483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:48.594288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:48.595414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:48.596312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:48.596312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:48.596312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:48.596312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:48.596312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 372/738] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:48.596600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.606706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 367/739] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:48.608244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac12b-d70c-43d0-b100-ed59703b2262 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.707445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efdc6-5784-464c-8a90-8f6247b570cc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.718783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:48.722745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac12b-d70c-43d0-b100-ed59703b2262 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.748175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.748972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.749259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.749572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.759960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:48.760742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.761656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.762145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.762613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:48.767707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:48.768619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:48.769504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 373/740] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:48.770224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.801792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:48.837866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:48.839536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:48.884667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739c1f0-bcf8-48e6-b937-a46324006759 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:48.922349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:48.923476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:48.924354 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:48.924856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:48.925921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:48.926303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:48.927735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:48.943814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 374/741] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:48.943814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:48.944977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:48.953601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 368/742] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:48.954453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.035397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:49.051470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b1ada-e2e3-451a-976e-114f822f9574 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.063419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5dad-8c89-42fd-a400-e56ef5db5401 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.087420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.088221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.088443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.088972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.089752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.091240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.102753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.103489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.103778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.104083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.104846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:49.105156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.106559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.115679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 369/743] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:49.116044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 375/744] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:06:48 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:49.116514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.117298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.211893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:49.255841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172c8f7-fe04-41cc-92a4-30d295e3dac7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.263069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a3cd-c62a-4fec-88bb-665672269e59 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.297828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.298944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.298944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.299141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.303033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.304045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.304527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.305011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.310927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.312380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.314226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:49.315636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.317656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:49.331914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:49.332831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:49.334343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:49.334343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:49.334343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:49.334343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:49.334343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 376/745] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:49.337792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:49.339303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:49.340219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:49.341158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:49.344437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 370/746] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:49.345519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.459144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668759b-37cd-4137-abfd-1f143598aa3f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.475611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afd30d-0c9d-46db-ba95-8324c66a5493 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.496726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:49.508843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.510280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.510567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.510846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.520983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.522024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.522986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.523483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.524642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:49.524750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.525221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.526420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.527268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.542512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 371/747] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:49.543577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:49.549494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:49.550385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:49.551421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:49.551421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:49.551421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:49.551421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:49.551421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 377/748] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:49.552615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.604348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:49.664710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec8ab8-dbf4-4e5c-9849-599166d29d72 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.684983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9b8f-661c-414c-a123-f701882b0b60 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.701713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.702547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.702930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.703305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.710777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.712385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:49.728096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:49.729204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:49.730632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:49.732651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.733580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.733991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.734389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.735368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:49.735801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.736990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 378/749] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:49.737717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.738071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.761546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 372/750] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:49.763318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.807190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:49.859774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7353-0060-4044-95dd-78589a8b67e4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.867921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:49.893566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0127-2721-431e-9bf4-1d2102a2d718 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:49.898728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.899516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.899909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.900289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.901145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:49.901589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.903134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.916239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 379/751] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:49.917241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:49.938894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:49.939824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:49.940248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:49.940659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:49.941605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:49.942474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:49.944303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:49.962749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 373/752] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:49.964014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.045479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ac2b1-af18-4833-8805-8fd72cccd50d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.068345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:50.072272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6afb34-81e9-4314-8e2c-777b9cf09396 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.088215 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.089275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.089581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.089853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.101095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.102584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.109111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d0ff2-5212-4cd7-8b6d-2c2873fd8a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.110023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d0ff2-5212-4cd7-8b6d-2c2873fd8a96 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.110223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d0ff2-5212-4cd7-8b6d-2c2873fd8a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.110491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d0ff2-5212-4cd7-8b6d-2c2873fd8a96 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.118309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d0ff2-5212-4cd7-8b6d-2c2873fd8a96 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.119721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d0ff2-5212-4cd7-8b6d-2c2873fd8a96 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:50.121316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:50.122377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:50.124065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:50.124065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:50.124065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:50.124065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:50.124065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 380/753] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:50.126268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-4f7d0ff2-5212-4cd7-8b6d-2c2873fd8a96 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:50.142805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:50.143937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:50.145148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 374/754] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:06:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:50.145794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e79a31-8323-4702-80ee-d238e301ec50 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.145794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e79a31-8323-4702-80ee-d238e301ec50 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.146054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e79a31-8323-4702-80ee-d238e301ec50 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.147455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 375/755] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:50.151834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e79a31-8323-4702-80ee-d238e301ec50 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.155945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:50.248960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53238-61ba-4ec7-a60d-2b9a5c4c4683 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.261724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e79a31-8323-4702-80ee-d238e301ec50 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.290565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.291241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.291671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.291960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.293364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=2ecb9bd88bce4c4c8014471d79105772) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:50.293788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.295940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.297748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12029b80-b877-40b8-87ec-9bc2b6d7d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.298709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029b80-b877-40b8-87ec-9bc2b6d7d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.299393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029b80-b877-40b8-87ec-9bc2b6d7d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.299679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029b80-b877-40b8-87ec-9bc2b6d7d4ad None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.300555 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12029b80-b877-40b8-87ec-9bc2b6d7d4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:50.300862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12029b80-b877-40b8-87ec-9bc2b6d7d4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.309859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 381/756] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/role_assignments?user.id=2ecb9bd88bce4c4c8014471d79105772&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:50.310073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12029b80-b877-40b8-87ec-9bc2b6d7d4ad None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.310225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.316260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 376/757] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:50.317372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9026-b66e-4866-817e-c89ba9611aad None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.317695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9026-b66e-4866-817e-c89ba9611aad None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.317972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9026-b66e-4866-817e-c89ba9611aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.339780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3d6d9026-b66e-4866-817e-c89ba9611aad None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:50.341080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3d6d9026-b66e-4866-817e-c89ba9611aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:50.363312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:50.435003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:50.442182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 377/758] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:50.443199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9026-b66e-4866-817e-c89ba9611aad None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.479185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bb95c-6370-41a9-bb6e-f208c2687e10 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.518974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.519461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.519745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.520019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.520922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:50.521161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.522679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.545371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 382/759] 10.222.0.47 () {56 vars in 1149 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:50.545371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.590451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9026-b66e-4866-817e-c89ba9611aad None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.628174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.628900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.629184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.629472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.637543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.639134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:50.654867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:50.655781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:50.656667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:50.660820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 378/760] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:50.661967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.674239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:50.678175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f8c6e-4600-4b91-82ec-317b2ad13dab None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.719490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.720400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.720753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.721105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.721861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.723364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:50.737984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:50.738960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:50.739782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 383/761] 10.222.0.47 () {56 vars in 1129 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:50.740639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.745681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:50.797352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9505-ea20-4407-84bf-92a53563d8fc None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.843919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.845224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.846045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.846932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.852451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281669-144d-4c96-baa1-efb22206ea20 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.896628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.897658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.898632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.899136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.900576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:50.901105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.903499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.921650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 384/762] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:50.922743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.933637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.935766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.945751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.002720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.047572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 379/763] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:06:51.047572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.061410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e8d40-ee95-4338-96f5-3d6af4711958 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.099130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.100143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.100672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.101156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.102094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:51.102604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.104184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.109451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 385/764] 10.222.0.47 () {56 vars in 1124 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:51.110573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.153161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2d223-9ce4-4c06-85d3-372b98a2e2e3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.162899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.190819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.191760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.192043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.192370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/1fe6b95088494836b8598ea8f33d5167/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.194566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=1fe6b95088494836b8598ea8f33d5167, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.195996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.214520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 380/765] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:51 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/1fe6b95088494836b8598ea8f33d5167/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:51.215337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.221610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6ba7-0507-4e1c-ba81-db62920521ee None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.253548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.264057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71d3ad-3f32-4c38-b5b6-65ee4d45263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.265257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d3ad-3f32-4c38-b5b6-65ee4d45263f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.265821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d3ad-3f32-4c38-b5b6-65ee4d45263f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.266361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d3ad-3f32-4c38-b5b6-65ee4d45263f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.278952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71d3ad-3f32-4c38-b5b6-65ee4d45263f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.280882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71d3ad-3f32-4c38-b5b6-65ee4d45263f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ed71d3ad-3f32-4c38-b5b6-65ee4d45263f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:51.301567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:51.302760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:51.303663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:51.303663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:51.303663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:51.303663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:51.311134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 386/766] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:51.313054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f042b5-fd41-4242-9932-486cc4bf4a02 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.313657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f042b5-fd41-4242-9932-486cc4bf4a02 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.314140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f042b5-fd41-4242-9932-486cc4bf4a02 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.316025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 387/767] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:51.317085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f042b5-fd41-4242-9932-486cc4bf4a02 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.350483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec3df-ffcb-4f9b-9216-3dee4dc89e46 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.403287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9561-31bf-4966-b066-e6c19acaace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.404414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9561-31bf-4966-b066-e6c19acaace5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.404947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9561-31bf-4966-b066-e6c19acaace5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.405504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9561-31bf-4966-b066-e6c19acaace5 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.406455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9561-31bf-4966-b066-e6c19acaace5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:51.406770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9561-31bf-4966-b066-e6c19acaace5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.408156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9561-31bf-4966-b066-e6c19acaace5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.417164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 381/768] 10.222.0.47 () {56 vars in 1124 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:51.417164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6eb1b-c8e7-436b-893c-a3f6cfb30c36 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.417164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6eb1b-c8e7-436b-893c-a3f6cfb30c36 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.417164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6eb1b-c8e7-436b-893c-a3f6cfb30c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.441499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-34f6eb1b-c8e7-436b-893c-a3f6cfb30c36 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:51.441499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-34f6eb1b-c8e7-436b-893c-a3f6cfb30c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:51.464178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f042b5-fd41-4242-9932-486cc4bf4a02 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.472272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.512717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.513705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.514060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.514409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.515205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:51.515581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.517057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.528711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 382/769] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:51.529638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6eb1b-c8e7-436b-893c-a3f6cfb30c36 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.535644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 388/770] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:51.541971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.597873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.666527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7921b5-6fe1-419e-a3a7-8f76e39ec80d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.676119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6eb1b-c8e7-436b-893c-a3f6cfb30c36 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.702838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.703905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.704192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.704652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.713217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.714250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.715010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.715126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.715553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.715960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.717450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] RBAC: Adding query filter params (interface=public, service_id=181be59b5203486bb18aac5e7e7aa682, region_id=RegionOne) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:51.717862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.719381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.727424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 383/771] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/endpoints?service_id=181be59b5203486bb18aac5e7e7aa682&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:51.728235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:51.737814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:51.739088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:51.740194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:51.745618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 389/772] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:51.746536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.765121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.860074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20f2e-7326-4366-ab56-23189e4b4e48 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.873090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:51.878388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7faea1-4e9e-43d2-8e3b-b73e3755c437 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:51.895552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.896350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.896634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.896911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.897637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.898989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:51.911813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:51.912831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:51.913716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:51.917948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 384/773] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:51.918728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:51.927008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:51.927973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.928461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.928985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.930258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:51.931635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:51.940563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 390/774] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:51.945668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.094775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:52.112653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2b99-8649-4bbe-9264-644db22f7fd1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.157495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.158229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.158511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.158789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.160945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409d14b-7c37-4b81-98d6-56218365d015 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.162452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:52.162994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.164732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.180848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 385/775] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:52.188419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.207115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.208868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.209364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.209876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.211407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] RBAC: Adding query filter params (name=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:52.211957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.213787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.221049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 391/776] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:06:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:52.226676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.258641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:52.320322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756f79-9db6-4591-9411-796bfd805360 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.344557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7492c9f-57a5-4c07-a0a8-0ffb3ef85503 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.363246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f2a5e-2cb7-490d-bc39-361702717c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.363919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f2a5e-2cb7-490d-bc39-361702717c32 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.364206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f2a5e-2cb7-490d-bc39-361702717c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.364629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f2a5e-2cb7-490d-bc39-361702717c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.365658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f2a5e-2cb7-490d-bc39-361702717c32 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=e051cec907124f158a099e1428150e5c) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:52.365979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f2a5e-2cb7-490d-bc39-361702717c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.367641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f2a5e-2cb7-490d-bc39-361702717c32 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.381538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 386/777] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/role_assignments?user.id=e051cec907124f158a099e1428150e5c&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:52.391530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.392218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.392506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.392786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.393552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:52.393866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.395283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.404887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d414baf-2bf8-4dc7-bbb5-82b03cbd2d01 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.405184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d414baf-2bf8-4dc7-bbb5-82b03cbd2d01 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.405448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d414baf-2bf8-4dc7-bbb5-82b03cbd2d01 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.405692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 392/778] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:52.407164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 387/779] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:52.409789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.423930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039c21c-39e2-42cb-9fa3-c62b0a72e623 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.424268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039c21c-39e2-42cb-9fa3-c62b0a72e623 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.424497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039c21c-39e2-42cb-9fa3-c62b0a72e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.455499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f039c21c-39e2-42cb-9fa3-c62b0a72e623 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:52.456685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f039c21c-39e2-42cb-9fa3-c62b0a72e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:52.484209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:52.589177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 388/780] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:06:52.590211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:52.594670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df2775-aa93-41c3-95a7-1c6ce717b9b6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.613153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039c21c-39e2-42cb-9fa3-c62b0a72e623 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.635269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.635939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.636224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.636500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.637303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] RBAC: Adding query filter params (interface=public, service_id=e70330c6ec074f548c14df055044c256, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:52.640738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.642171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.656136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 393/781] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/endpoints?service_id=e70330c6ec074f548c14df055044c256&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:52.662179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.807767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef772-3a77-418f-80bd-11ed1873ef0f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.812120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039c21c-39e2-42cb-9fa3-c62b0a72e623 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.847765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.848433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.848716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.848994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.849729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.853482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.857537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 394/782] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:52.887985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.889597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.890030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.890451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.914208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:52.922219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:52.923350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:52.924412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:52.926859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 389/783] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:52.932798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.972126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:53.073270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe52776-d1d7-451a-9a88-93594b193e42 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:53.115182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:53.115862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:53.116148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:53.116428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:53.117246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:53.117588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:53.119019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:53.129653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 395/784] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:53.134984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:53.141507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:53.279591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4970-d3c6-4754-a364-9d56f5c532b5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:53.328070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:53.328785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:53.329111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:53.329387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:53.345776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:53.347243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:53.376284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:53.377234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:53.378227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:53.378227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:53.378227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:53.378227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:53.381567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 390/785] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:53.383736 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:53.504444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:53.532735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76975cdf-488f-4d06-9aed-c9e18d8c461f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:53.575249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c3f59-681c-4bb8-aaa6-807f1d9ddd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:53.576443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c3f59-681c-4bb8-aaa6-807f1d9ddd09 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:53.576726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c3f59-681c-4bb8-aaa6-807f1d9ddd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:53.577002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c3f59-681c-4bb8-aaa6-807f1d9ddd09 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:53.577748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c3f59-681c-4bb8-aaa6-807f1d9ddd09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:53.578056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c3f59-681c-4bb8-aaa6-807f1d9ddd09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:53.579474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c3f59-681c-4bb8-aaa6-807f1d9ddd09 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:53.600870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 396/786] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:53.606481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:53.693851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:53.751079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c716-4f7c-4db3-8088-e11334598b43 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:53.751430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c716-4f7c-4db3-8088-e11334598b43 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:53.751641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c716-4f7c-4db3-8088-e11334598b43 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:53.753253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 397/787] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:06:53.754018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71619b0b-cdeb-4e32-b560-07924bf43c9a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:53.758109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586f4f-4efc-446a-93d9-e4a4471797bf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:53.758392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586f4f-4efc-446a-93d9-e4a4471797bf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:53.758669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586f4f-4efc-446a-93d9-e4a4471797bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:53.790851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:53.791948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:53.792437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:53.792897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:53.794485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-60586f4f-4efc-446a-93d9-e4a4471797bf None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:53.795783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-60586f4f-4efc-446a-93d9-e4a4471797bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:53.801495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:53.803172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:53.817342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:53.818317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:53.819261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:53.821502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 391/788] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:53.834339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:53.944158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e46ee-3eba-460d-9145-2867b41bd175 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:53.944906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 398/789] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:53.973909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:53.991668 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:53.992576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:53.993734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:53.993734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:53.993917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60586f4f-4efc-446a-93d9-e4a4471797bf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:53.994172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:53.994486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:53.996055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.015484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 392/790] 10.222.0.47 () {56 vars in 1135 bytes} [Thu Jun 30 13:06:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:54.022681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.082447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:54.109891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60586f4f-4efc-446a-93d9-e4a4471797bf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.145748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.146549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.146833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.147110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.157748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:54.165293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:54.166226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:54.167309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 399/791] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:54.172857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.208148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db443ef-e4be-4992-a9af-1864b283f6be None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.247324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.248644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.248925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.249204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.261565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:54.263026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:54.283647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:54.284586 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:54.285954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:54.285954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:54.285954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:54.285954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:54.285954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 393/792] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:54.291244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.341804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:54.422791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb09e6-c2ff-464f-9606-badc0fc953e7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.459998 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893a6d4-b004-4da9-8080-9193bf7c1250 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.467606 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:54.473280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb1899-c3a4-45bc-a912-8f954287009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.474010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb1899-c3a4-45bc-a912-8f954287009a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.474293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb1899-c3a4-45bc-a912-8f954287009a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.474564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb1899-c3a4-45bc-a912-8f954287009a None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.475314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb1899-c3a4-45bc-a912-8f954287009a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:54.475629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb1899-c3a4-45bc-a912-8f954287009a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:54.477004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb1899-c3a4-45bc-a912-8f954287009a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.486821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 400/793] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:54.488640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f8a5-2255-4e72-9b17-5a5a9faa0914 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.489011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f8a5-2255-4e72-9b17-5a5a9faa0914 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.489357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f8a5-2255-4e72-9b17-5a5a9faa0914 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.490928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 401/794] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:54.492245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f8a5-2255-4e72-9b17-5a5a9faa0914 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.505695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578e39e-582d-4f51-bb8c-86b8a605e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.506361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e39e-582d-4f51-bb8c-86b8a605e6af None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.506645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e39e-582d-4f51-bb8c-86b8a605e6af None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.506913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e39e-582d-4f51-bb8c-86b8a605e6af None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.507637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578e39e-582d-4f51-bb8c-86b8a605e6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:54.507939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578e39e-582d-4f51-bb8c-86b8a605e6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:54.509301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578e39e-582d-4f51-bb8c-86b8a605e6af None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.521482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 394/795] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:54.522758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eba23-3864-4443-8f99-e06752257cc9 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.523046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eba23-3864-4443-8f99-e06752257cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.523319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eba23-3864-4443-8f99-e06752257cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.546978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-169eba23-3864-4443-8f99-e06752257cc9 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:54.548163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-169eba23-3864-4443-8f99-e06752257cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:54.618582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f8a5-2255-4e72-9b17-5a5a9faa0914 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.625535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 395/796] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:54.626429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eba23-3864-4443-8f99-e06752257cc9 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.652859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:54.656786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.658113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.658397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.658780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.669637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:54.671129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:54.689867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:54.690769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:54.692079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:54.692079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:54.692079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:54.692079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:54.692079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 402/797] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:54.692079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.742230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:54.744443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eba23-3864-4443-8f99-e06752257cc9 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.780549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.781334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.781647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.781921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.788578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:54.790051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.798525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d582f-dbb5-4f5d-8862-6c6b658af4b2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:54.803642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:54.804522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:54.805420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:54.809643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 396/798] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:54.810813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.837278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359ba8-75e8-4227-a7e8-2d4d0d8fd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.837869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359ba8-75e8-4227-a7e8-2d4d0d8fd113 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.838156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359ba8-75e8-4227-a7e8-2d4d0d8fd113 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.838433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359ba8-75e8-4227-a7e8-2d4d0d8fd113 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.839346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359ba8-75e8-4227-a7e8-2d4d0d8fd113 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:54.840760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359ba8-75e8-4227-a7e8-2d4d0d8fd113 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d3359ba8-75e8-4227-a7e8-2d4d0d8fd113 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:54.853409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:54.854497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 13:06:54.855415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:54.857787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 403/799] 10.222.0.47 () {56 vars in 1129 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:54.859959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75bea6-b0c8-48d4-98cb-31f39a7a4f48 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.860246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75bea6-b0c8-48d4-98cb-31f39a7a4f48 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.860521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75bea6-b0c8-48d4-98cb-31f39a7a4f48 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.862495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 404/800] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:54.866498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75bea6-b0c8-48d4-98cb-31f39a7a4f48 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.896579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:54.924245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7824bd-54c6-458e-b094-71e189d24e35 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.958979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:54.959563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:54.959847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:54.960131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:54.960842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:54.961147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:54.962554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:54.971175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75bea6-b0c8-48d4-98cb-31f39a7a4f48 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:54.978776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 397/801] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:54.978776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:54.983658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:55.010306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a86f-7223-45c6-a5ba-4951e2fd8c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.011220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a86f-7223-45c6-a5ba-4951e2fd8c26 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.011649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a86f-7223-45c6-a5ba-4951e2fd8c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.012069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a86f-7223-45c6-a5ba-4951e2fd8c26 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.013007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a86f-7223-45c6-a5ba-4951e2fd8c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:55.013948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a86f-7223-45c6-a5ba-4951e2fd8c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.015377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a86f-7223-45c6-a5ba-4951e2fd8c26 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.027715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 405/802] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:55.028888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59d16-ac8a-401b-a9be-55b3a04559d4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.029181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59d16-ac8a-401b-a9be-55b3a04559d4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.029482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59d16-ac8a-401b-a9be-55b3a04559d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.047469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ffe59d16-ac8a-401b-a9be-55b3a04559d4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:55.048828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ffe59d16-ac8a-401b-a9be-55b3a04559d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:55.096539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55dcf-f05c-4800-bbac-d13330f13af2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.125495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 406/803] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:55.125495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59d16-ac8a-401b-a9be-55b3a04559d4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.242702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:55.246239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59d16-ac8a-401b-a9be-55b3a04559d4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.248975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.249682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.249966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.250899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.251133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:55.251367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.252729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.255015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:55.259337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 398/804] 10.222.0.47 () {56 vars in 1124 bytes} [Thu Jun 30 13:06:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:55.262456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.283040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.283818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.284116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.284372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.291775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.293245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:55.307951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:55.308931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:06:55.309920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:55.313882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 407/805] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:06:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:55.315023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.378966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c036c-7b1c-447e-8a64-4bbf0083dba5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.412942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.413852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.414134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.414407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/2ecb9bd88bce4c4c8014471d79105772/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.416354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=2ecb9bd88bce4c4c8014471d79105772, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.417799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.424020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a080e8-fde2-499f-867b-db33d57718b1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.430632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 399/806] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:55 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/2ecb9bd88bce4c4c8014471d79105772/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:55.431415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.473936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.474746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.475061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.475304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.488117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:55.496624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:55.497685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 408/807] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:06:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:55.499580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.511055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:55.525661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:55.564735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14665a9e-2559-402f-b679-163dddbdac6c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.603903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf607-ac80-437b-8480-34c1fb9a1d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.604656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf607-ac80-437b-8480-34c1fb9a1d91 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.604943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf607-ac80-437b-8480-34c1fb9a1d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.605222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf607-ac80-437b-8480-34c1fb9a1d91 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.605953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf607-ac80-437b-8480-34c1fb9a1d91 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:55.606262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf607-ac80-437b-8480-34c1fb9a1d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.608424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf607-ac80-437b-8480-34c1fb9a1d91 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.617558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 400/808] 10.222.0.47 () {56 vars in 1124 bytes} [Thu Jun 30 13:06:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:55.617558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a867-983e-4070-9db5-f7ada87169f4 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.617558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a867-983e-4070-9db5-f7ada87169f4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.617558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a867-983e-4070-9db5-f7ada87169f4 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.617558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 401/809] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:55.617558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a867-983e-4070-9db5-f7ada87169f4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.623656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613c7a-c443-4ef3-b2ac-f408805a7ebf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.661014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.661718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.662109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.662385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.663214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:55.663525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.665067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.685619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 409/810] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:06:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:55.686835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.733222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a867-983e-4070-9db5-f7ada87169f4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.758980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:55.770674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5b268-73fd-4d94-897d-18332394444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.771336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b268-73fd-4d94-897d-18332394444f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.771613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b268-73fd-4d94-897d-18332394444f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.771885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b268-73fd-4d94-897d-18332394444f None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.772622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5b268-73fd-4d94-897d-18332394444f None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:55.772923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5b268-73fd-4d94-897d-18332394444f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.774308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5b268-73fd-4d94-897d-18332394444f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.783561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 402/811] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:06:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:55.784738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6d726-d13e-4a9f-bc6d-c1eeadeec1d6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.785026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6d726-d13e-4a9f-bc6d-c1eeadeec1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.785302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6d726-d13e-4a9f-bc6d-c1eeadeec1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.792109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:55.802631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-49e6d726-d13e-4a9f-bc6d-c1eeadeec1d6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:55.803482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-49e6d726-d13e-4a9f-bc6d-c1eeadeec1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:55.816669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78a60-d8fe-4617-9f9a-9763f727804b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:55.854758 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:55.855570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:55.855965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:55.856336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:55.857205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:55.858686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:55.872564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 403/812] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:55.873415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6d726-d13e-4a9f-bc6d-c1eeadeec1d6 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:55.894778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 410/813] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:06:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:55.895906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.018317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6d726-d13e-4a9f-bc6d-c1eeadeec1d6 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.036391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4e22-8a3b-41f1-b804-83870354e6a8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.041125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.069057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.069818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.070091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.070364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.074243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.086201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.086549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.087750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.088114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.100722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.102276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:56.120414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:56.121596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:56.123249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:56.123249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:56.123249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:56.123249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:56.124052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 411/814] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:56.128563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.160186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.161777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.250798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2da5d-506b-4174-826f-93a038ab585d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.284192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 404/815] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:06:56.285754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.294536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.295632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.296197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.296673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] PATH_INFO: `/v3/services/network` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.297663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.299249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.304143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:56.314609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:56.315602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 13:06:56.316424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:56.319462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 412/816] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:56.320662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.373675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.414099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f5224-b9a3-4164-9a90-54e128982006 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.434471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d64895-3731-48ac-94a1-3cb99bec74ce None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.459368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.460208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.460592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.461120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.462297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:56.462722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.464867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.473310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.474329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.474771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.475182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.485896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 405/817] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:56.486920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.489617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.491213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:56.511512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:56.512878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:56.514421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:56.514421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:56.514421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:56.514421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:56.516589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 413/818] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:56.517665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.582536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.613378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f55c-2ea1-4e45-9d23-7598531170df None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.628683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.633973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4da5cd-6b4c-465a-952b-b5973a5ec232 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.661297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.662579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.663040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.663681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.665115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] RBAC: Adding query filter params (name=network) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:56.665744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.667926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.672854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.673798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.674151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.674499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.675713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 406/819] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:56.676723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.687973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.689602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:56.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:56.706270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:06:56.707292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:56.711558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 414/820] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:56.712639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.795185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd4a8-e47f-4cbe-af7a-8261b1918b06 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.832707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6561-85c6-4332-98e0-b1ca683d7607 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.837438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.838316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.839023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.839472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.840890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:56.841407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.843387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.855383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.862817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 407/821] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:56.863803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.875375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.876132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.876493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.876841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.877692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] RBAC: Adding query filter params (type=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:56.878370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.879520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.889344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 415/822] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:56.890283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.917249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.992522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03470c40-7b7e-4b8c-84cb-5f24eaf4e7db None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.999020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c3127-a86a-4726-86a4-adb3186b7a09 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.032218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.033084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.033436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.033876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.034922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:57.035276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.036868 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.043523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.044740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.045299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.045775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.054390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.056375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.061622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 408/823] 10.222.0.47 () {56 vars in 1149 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:57.061622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:57.081323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:57.082471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:57.083577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:57.086314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 416/824] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:57.087551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.165960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.186240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e087b5-0ea0-4c5e-bb9b-c60cb79c3b7a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.209847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27de03-9dfd-49fb-aef1-9369af5bd1ca None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.228962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.229640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.230046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.230343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.231349 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.231681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.232744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.254086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.255339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.255897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.256349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.265489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 409/825] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:57.265489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.282307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.284204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:57.315703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:57.316704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:57.317630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:57.317630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:57.317630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:57.317630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:57.326442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 417/826] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:57.332442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.392005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637eb28c-233d-4b93-a993-c703affe47f2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.415500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.464898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.465894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.466369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.466782 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.467728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:57.468186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.469849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.497328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 410/827] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:57.509947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.527422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d856-5482-4ec9-a49b-e02c82c950ab None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.572639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3281ff-3ccc-4e15-adc9-12298bed0b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.573754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3281ff-3ccc-4e15-adc9-12298bed0b0b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.574240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3281ff-3ccc-4e15-adc9-12298bed0b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.574724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3281ff-3ccc-4e15-adc9-12298bed0b0b None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.575730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3281ff-3ccc-4e15-adc9-12298bed0b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:57.576234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3281ff-3ccc-4e15-adc9-12298bed0b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.577900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3281ff-3ccc-4e15-adc9-12298bed0b0b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.579686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.592569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 418/828] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:57.594222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca4595-5ab5-4817-b2cd-7307f93a9969 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.594712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca4595-5ab5-4817-b2cd-7307f93a9969 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.595203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca4595-5ab5-4817-b2cd-7307f93a9969 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.596921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 419/829] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:57.598840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca4595-5ab5-4817-b2cd-7307f93a9969 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.641833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d609-cbb3-4bc3-82af-c823e9a9dfce None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.678093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10821a58-76aa-4356-98eb-d559b2e082cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.678766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821a58-76aa-4356-98eb-d559b2e082cf None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.679055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821a58-76aa-4356-98eb-d559b2e082cf None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.679323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821a58-76aa-4356-98eb-d559b2e082cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.680148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821a58-76aa-4356-98eb-d559b2e082cf None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=1fe6b95088494836b8598ea8f33d5167) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:57.680457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821a58-76aa-4356-98eb-d559b2e082cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.681909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821a58-76aa-4356-98eb-d559b2e082cf None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.694283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 411/830] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/role_assignments?user.id=1fe6b95088494836b8598ea8f33d5167&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:57.694283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac6296-f5ee-4e12-8990-8328cce4dc65 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.694283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac6296-f5ee-4e12-8990-8328cce4dc65 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.694283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac6296-f5ee-4e12-8990-8328cce4dc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.710109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3fac6296-f5ee-4e12-8990-8328cce4dc65 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:57.711703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3fac6296-f5ee-4e12-8990-8328cce4dc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:57.724155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca4595-5ab5-4817-b2cd-7307f93a9969 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.751417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.766559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474799-374e-4688-b1f0-24f807804391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.767469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474799-374e-4688-b1f0-24f807804391 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.767880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474799-374e-4688-b1f0-24f807804391 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.768228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474799-374e-4688-b1f0-24f807804391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.776174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36474799-374e-4688-b1f0-24f807804391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.777815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36474799-374e-4688-b1f0-24f807804391 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-36474799-374e-4688-b1f0-24f807804391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:57.793924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:57.795695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:57.796586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 420/831] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:57.801981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474799-374e-4688-b1f0-24f807804391 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.817566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 412/832] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:57.844297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac6296-f5ee-4e12-8990-8328cce4dc65 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.870380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.924772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474799-374e-4688-b1f0-24f807804391 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.978383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.979044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.979328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.979605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.979836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac6296-f5ee-4e12-8990-8328cce4dc65 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.980393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:57.980701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.983026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.999666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 421/833] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:58.004848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.019005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.020269 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.020755 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.021276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.034828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:06:58.043252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:58.044261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:06:58.045206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:58.048206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 413/834] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:58.054439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.084461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.168203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4d400-52ca-4f06-ab7d-acf95e00026b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.203091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374612e-597e-4213-a479-172392c6247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.203676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374612e-597e-4213-a479-172392c6247c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.203955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374612e-597e-4213-a479-172392c6247c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.204228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374612e-597e-4213-a479-172392c6247c None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.204963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374612e-597e-4213-a479-172392c6247c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:58.205361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374612e-597e-4213-a479-172392c6247c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.206649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374612e-597e-4213-a479-172392c6247c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.215802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 414/835] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:58.217903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056645b-db16-4f7d-9bb6-2ecde838caae None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.218193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056645b-db16-4f7d-9bb6-2ecde838caae None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.218467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056645b-db16-4f7d-9bb6-2ecde838caae None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.219803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 415/836] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:58.222290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056645b-db16-4f7d-9bb6-2ecde838caae None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.236098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958209-296d-4cee-be81-fa356f7912fb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.251253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.273635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6a0e-84b1-4a41-8d5f-1aecc4ef6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.274510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6a0e-84b1-4a41-8d5f-1aecc4ef6622 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.274831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6a0e-84b1-4a41-8d5f-1aecc4ef6622 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.275116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6a0e-84b1-4a41-8d5f-1aecc4ef6622 None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/e051cec907124f158a099e1428150e5c/roles/459550c1127b4295b6ceedf2ebd8003c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.289849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6a0e-84b1-4a41-8d5f-1aecc4ef6622 None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=e051cec907124f158a099e1428150e5c, role_id=459550c1127b4295b6ceedf2ebd8003c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.291281 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6a0e-84b1-4a41-8d5f-1aecc4ef6622 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.305993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 422/837] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:06:58 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/e051cec907124f158a099e1428150e5c/roles/459550c1127b4295b6ceedf2ebd8003c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:06:58.308038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a8d58-a24d-44b1-93cc-b26eb2ce29b4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.308846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a8d58-a24d-44b1-93cc-b26eb2ce29b4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.309684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a8d58-a24d-44b1-93cc-b26eb2ce29b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.315921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.335790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056645b-db16-4f7d-9bb6-2ecde838caae None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.345744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c11a8d58-a24d-44b1-93cc-b26eb2ce29b4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:58.351593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c11a8d58-a24d-44b1-93cc-b26eb2ce29b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:58.383214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.384052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.384337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.384611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.397493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.399011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:58.418643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:58.419691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:58.420601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:58.420601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:58.420601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:58.420601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:58.420601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 416/838] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:58.425583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.454678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 423/839] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:06:58.478230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a8d58-a24d-44b1-93cc-b26eb2ce29b4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.550194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39098a-ae2c-433c-a7cf-690f53e4ffb8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.580819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.590256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a8d58-a24d-44b1-93cc-b26eb2ce29b4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.596905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.597880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.598359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.598819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.599728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:58.600247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.601867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.609837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.615536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 417/840] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:58.621392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.636212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.637317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.637430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.637695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.638931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.640483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:58.653108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:58.654232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:06:58.655099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 424/841] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:58.660830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.744485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc87135-3b7e-4bc3-bb0f-7840f3b7732a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.765543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f04ee-69e4-4658-bd7c-0d398604cb7a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.783596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.784531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.784919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.785299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.793709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.795814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.802232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.803088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.803513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.803928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.804764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:58.805207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.806744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.812629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 425/842] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:06:58.813425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:58.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 13:06:58.815678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:58.821999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 418/843] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:06:58.822149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.822961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.848213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.889703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.928880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6dde7-87ca-4b45-bc40-8102c10d72c1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.939357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662681e9-34ab-4081-bf86-bc10ac1a321a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.964594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.965580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.966074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.966516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.967366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:58.967833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.969392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.974744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 426/844] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:58.981008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.982542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.982984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.983383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.984392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:58.984837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.986587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:59.008718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 419/845] 10.222.0.47 () {56 vars in 1135 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:59.014480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:59.111475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:59.127830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ed83b-b434-4893-87b9-2506ed195cad None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:59.162611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:59.163257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:59.163533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:59.163804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:59.232911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:59.234379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:59.322054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:59.340929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 427/846] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:06:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:06:59.346074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:59.450241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786acd6-d451-4407-af24-1b50e5fbf587 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:59.469351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:59.489716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:59.490887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:59.491388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:59.491866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:59.503195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:59.504953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:06:59.524368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:59.525358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:59.526344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:06:59.526344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:06:59.526344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:06:59.526344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:59.529270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 420/847] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:59.541503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:59.635697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b61f0-5190-49e8-916b-00f7da058fd4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:59.670905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc519e9-1398-46e9-beb7-e67751476f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:59.671562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc519e9-1398-46e9-beb7-e67751476f7d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:59.671841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc519e9-1398-46e9-beb7-e67751476f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:59.672111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc519e9-1398-46e9-beb7-e67751476f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:59.672825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc519e9-1398-46e9-beb7-e67751476f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:59.673125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc519e9-1398-46e9-beb7-e67751476f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:59.674506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc519e9-1398-46e9-beb7-e67751476f7d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:59.686519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 428/848] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:59.691652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:59.797773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ee97-b22c-40b4-9478-1e8fd59cd608 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:59.833853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:59.834993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:59.835484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:59.835995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:59.844018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:59.845705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:59.848673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d307f3-6f46-46de-93e3-9f96becc72b7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:59.848965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d307f3-6f46-46de-93e3-9f96becc72b7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:59.849310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d307f3-6f46-46de-93e3-9f96becc72b7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:59.850991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 429/849] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:06:59.855425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683d5a-65b9-4d28-8006-0eabf5b5cebb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:59.855715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683d5a-65b9-4d28-8006-0eabf5b5cebb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:59.855998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683d5a-65b9-4d28-8006-0eabf5b5cebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:06:59.861334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:06:59.862318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:06:59.863336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:06:59.865377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 421/850] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:06:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:06:59.875324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:59.875476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5d683d5a-65b9-4d28-8006-0eabf5b5cebb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:59.875476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5d683d5a-65b9-4d28-8006-0eabf5b5cebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:59.906994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:59.930399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:59.964157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 430/851] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:06:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:06:59.985626 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683d5a-65b9-4d28-8006-0eabf5b5cebb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:59.993796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe68ddf-7c5c-4629-982c-4ba48783e6d6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.032690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.033348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.033663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.033939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.034722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:00.035033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:00.036693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:00.050366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 422/852] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:06:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:00.057029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:00.106244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683d5a-65b9-4d28-8006-0eabf5b5cebb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.147824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.148730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.149090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.149436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.150182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:00.152154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:00.165933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:00.169288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:00.170508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:00.171549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:00.177489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 431/853] 10.222.0.47 () {56 vars in 1132 bytes} [Thu Jun 30 13:06:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:00.177489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:00.186556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa562ce-dc64-4a26-a746-225170ed297f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.228457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.229264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.229676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.230403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.231639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=2ecb9bd88bce4c4c8014471d79105772) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:00.232086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:00.234065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:00.237432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:00.245572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 423/854] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:00 2022] GET /identity/v3/role_assignments?user.id=2ecb9bd88bce4c4c8014471d79105772&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:00.301099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9024a-8020-4518-8c28-d379fb7b4149 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.340877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d176be-9590-40b8-8abc-b77706b4e517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.341636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d176be-9590-40b8-8abc-b77706b4e517 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.341920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d176be-9590-40b8-8abc-b77706b4e517 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.342194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d176be-9590-40b8-8abc-b77706b4e517 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.342912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d176be-9590-40b8-8abc-b77706b4e517 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:00.343217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d176be-9590-40b8-8abc-b77706b4e517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:00.344683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d176be-9590-40b8-8abc-b77706b4e517 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:00.352755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 432/855] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:00.356167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:00.466869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d02d7-5834-4b2a-a287-604184cc52b8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.501816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eca47-788e-4fd4-a1b6-5359600c2850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.502479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eca47-788e-4fd4-a1b6-5359600c2850 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.502761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eca47-788e-4fd4-a1b6-5359600c2850 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.503034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eca47-788e-4fd4-a1b6-5359600c2850 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.503735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eca47-788e-4fd4-a1b6-5359600c2850 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:00.504038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eca47-788e-4fd4-a1b6-5359600c2850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:00.505401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eca47-788e-4fd4-a1b6-5359600c2850 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:00.510571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 424/856] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:00.517340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d3bd-5acb-424f-ba4e-df4d454d264f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.517340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d3bd-5acb-424f-ba4e-df4d454d264f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.517340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d3bd-5acb-424f-ba4e-df4d454d264f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.517340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 433/857] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:00.523919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835391db-8087-4667-9a8d-c0d4d83b3c1b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.524551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835391db-8087-4667-9a8d-c0d4d83b3c1b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.525065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835391db-8087-4667-9a8d-c0d4d83b3c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.543431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-835391db-8087-4667-9a8d-c0d4d83b3c1b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:00.545562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-835391db-8087-4667-9a8d-c0d4d83b3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:00.558252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:00.620988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 425/858] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:00.645665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d3bd-5acb-424f-ba4e-df4d454d264f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:00.757842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d3bd-5acb-424f-ba4e-df4d454d264f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.761141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:00.801644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.802436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.802714 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.802985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.813757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:00.821580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:00.822557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:00.823427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 434/859] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:07:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:00.830571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835391db-8087-4667-9a8d-c0d4d83b3c1b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:00.931369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835391db-8087-4667-9a8d-c0d4d83b3c1b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.970170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab2d9d-8fd8-4a6e-9f01-4eab47df6e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.970844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2d9d-8fd8-4a6e-9f01-4eab47df6e74 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.971137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2d9d-8fd8-4a6e-9f01-4eab47df6e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.971415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2d9d-8fd8-4a6e-9f01-4eab47df6e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.972160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab2d9d-8fd8-4a6e-9f01-4eab47df6e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:00.972468 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab2d9d-8fd8-4a6e-9f01-4eab47df6e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:00.973866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab2d9d-8fd8-4a6e-9f01-4eab47df6e74 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:00.983238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 426/860] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:07:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:00.988864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:01.096241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad208563-5893-4b83-bfb0-20ea1d35f53f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:01.131507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:01.132671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.133209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.133716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.141931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a0df-fc7a-4c82-a18a-7413a37fbfd7 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.142160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a0df-fc7a-4c82-a18a-7413a37fbfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.142405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a0df-fc7a-4c82-a18a-7413a37fbfd7 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.144953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 427/861] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:01.146464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:01.148138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:01.148978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffe02-a2ba-4bbe-9e5c-8a8f3fa6c31e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.149270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffe02-a2ba-4bbe-9e5c-8a8f3fa6c31e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.149589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffe02-a2ba-4bbe-9e5c-8a8f3fa6c31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.167151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5e9ffe02-a2ba-4bbe-9e5c-8a8f3fa6c31e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:01.167842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:01.168732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:01.169708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:01.169708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:01.169708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:01.169708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:01.169933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5e9ffe02-a2ba-4bbe-9e5c-8a8f3fa6c31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:01.171947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 435/862] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:01.177507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:01.182554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:01.196939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:01.258781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 428/863] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:01.276931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffe02-a2ba-4bbe-9e5c-8a8f3fa6c31e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:01.295089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df045e3-9df0-483a-9c55-bb10c95db134 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:01.345032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:01.345738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.346641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.346870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.347885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:01.348198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:01.349855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:01.368960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 436/864] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:01.374532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:01.404768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffe02-a2ba-4bbe-9e5c-8a8f3fa6c31e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:01.442451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:01.443667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.444367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.444818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.445923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:01.447968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:01.463849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:01.472018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 429/865] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:07:01 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:01.478363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:01.510478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82481337-2449-4621-ac17-6d5ac9bf15e1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:01.557525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:01.558663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.559123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.559545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.568760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:01.570549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:01.588757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:01.590017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:01.591254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:01.593742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 437/866] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:07:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:01.601935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:01.709155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ad005-3269-49a7-af88-eaf2180851da None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:01.745356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:01.746057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.746340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.746611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.747982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:01.748292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:01.749746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:01.769093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 430/867] 10.222.0.47 () {56 vars in 1149 bytes} [Thu Jun 30 13:07:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:01.774308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:01.879334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407a491-ea94-4d7f-abd8-d8a52e34c2d7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:01.911588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:01.917341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:01.918080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.918534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.918812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.987586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:01.989045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.093857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 438/868] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:01 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:02.099228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.158039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:02.206606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fe2b-7d9c-44a6-a5ef-a6a28cd833af None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.243088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.243880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.244165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.244443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.255137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.256598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:02.274450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:02.275410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:02.276329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:02.276329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:02.276329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:02.276329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:02.276329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 431/869] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:02.282303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.317812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:02.396867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5ffd-9234-470a-a957-d345f29a8e74 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.432728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5baf-1995-4e12-bd34-d11eb1d61dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.433719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5baf-1995-4e12-bd34-d11eb1d61dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.434212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5baf-1995-4e12-bd34-d11eb1d61dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.434693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5baf-1995-4e12-bd34-d11eb1d61dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.435680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5baf-1995-4e12-bd34-d11eb1d61dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:02.436192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5baf-1995-4e12-bd34-d11eb1d61dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.437780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5baf-1995-4e12-bd34-d11eb1d61dd0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.450074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 439/870] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:02.459348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.519542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6a40-3959-4018-bb31-d52f7bdc8e9c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.519861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6a40-3959-4018-bb31-d52f7bdc8e9c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.520111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6a40-3959-4018-bb31-d52f7bdc8e9c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.521751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 440/871] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:02.526614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989f7a-374a-4518-afeb-01c88cb70c43 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.526902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989f7a-374a-4518-afeb-01c88cb70c43 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.527180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989f7a-374a-4518-afeb-01c88cb70c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.550437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-32989f7a-374a-4518-afeb-01c88cb70c43 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:02.551734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-32989f7a-374a-4518-afeb-01c88cb70c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:02.562026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486a9b-8d21-4c7d-bfd6-cf5f6556a3c1 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.571461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:02.597161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.598102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.598384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.598659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.605655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.608031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:02.622034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:02.623544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:02.624454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 432/872] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:02.629699 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.630685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 441/873] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:02.652909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32989f7a-374a-4518-afeb-01c88cb70c43 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.689936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:02.739835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f538086-d8d8-4f4a-98f4-f1380c0a147d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.775729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f2ae9-25d2-426d-9915-398a4e9a309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.776404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f2ae9-25d2-426d-9915-398a4e9a309b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.776685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f2ae9-25d2-426d-9915-398a4e9a309b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.776956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f2ae9-25d2-426d-9915-398a4e9a309b None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.777762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f2ae9-25d2-426d-9915-398a4e9a309b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:02.778066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f2ae9-25d2-426d-9915-398a4e9a309b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.779508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f2ae9-25d2-426d-9915-398a4e9a309b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.781076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32989f7a-374a-4518-afeb-01c88cb70c43 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.791406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 433/874] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:02.792638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8308a2-ca6f-4c9f-bd11-05fedd1bcd89 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.792925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8308a2-ca6f-4c9f-bd11-05fedd1bcd89 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.793198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8308a2-ca6f-4c9f-bd11-05fedd1bcd89 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.795128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 434/875] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:02.799528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8308a2-ca6f-4c9f-bd11-05fedd1bcd89 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.824356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58f05-7daa-4422-92cc-96074b79678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.825392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58f05-7daa-4422-92cc-96074b79678e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.825905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58f05-7daa-4422-92cc-96074b79678e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.826330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58f05-7daa-4422-92cc-96074b79678e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.827147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58f05-7daa-4422-92cc-96074b79678e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.828666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58f05-7daa-4422-92cc-96074b79678e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.829047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-95e58f05-7daa-4422-92cc-96074b79678e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:02.841764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:02.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:02.843649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 442/876] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:02.844448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47d49-3268-4700-a7c7-030423e6d43b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.844448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47d49-3268-4700-a7c7-030423e6d43b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.844579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47d49-3268-4700-a7c7-030423e6d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.863115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-41a47d49-3268-4700-a7c7-030423e6d43b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:02.864277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-41a47d49-3268-4700-a7c7-030423e6d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:02.912783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8308a2-ca6f-4c9f-bd11-05fedd1bcd89 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.928587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 443/877] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:02.934333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47d49-3268-4700-a7c7-030423e6d43b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.955657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:02.956246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.956898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.957182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.957454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.958363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=e051cec907124f158a099e1428150e5c) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:02.958681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.960091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.966704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 435/878] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:02 2022] GET /identity/v3/role_assignments?user.id=e051cec907124f158a099e1428150e5c&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:02.967447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.061233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47d49-3268-4700-a7c7-030423e6d43b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.096636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:03.103413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.104308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.104660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.104978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.105850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:03.106251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.108802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.112145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d018a-2b0f-4f31-8106-7c343584817b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.114908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 444/879] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:03.120221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.162293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ee092-16b2-44a6-b693-a75fd56b1d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.163393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ee092-16b2-44a6-b693-a75fd56b1d67 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.163393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ee092-16b2-44a6-b693-a75fd56b1d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.163584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ee092-16b2-44a6-b693-a75fd56b1d67 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.164216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ee092-16b2-44a6-b693-a75fd56b1d67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.166461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ee092-16b2-44a6-b693-a75fd56b1d67 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.183993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 436/880] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:07:02 2022] POST /identity/v3/services => generated 269 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:03.228294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:03.253686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4ac9d-10c6-4174-a9e5-0dfa2fdda4ce None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.305698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710d80b-fc98-42a5-b2cd-1af64ac9148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.306776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710d80b-fc98-42a5-b2cd-1af64ac9148a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.307397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710d80b-fc98-42a5-b2cd-1af64ac9148a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.307883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710d80b-fc98-42a5-b2cd-1af64ac9148a None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.308837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710d80b-fc98-42a5-b2cd-1af64ac9148a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:03.309386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710d80b-fc98-42a5-b2cd-1af64ac9148a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.311092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710d80b-fc98-42a5-b2cd-1af64ac9148a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.317385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 445/881] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:03.625325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ba3b-2e4e-4cf6-a11a-c68605adb7f9 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.625924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ba3b-2e4e-4cf6-a11a-c68605adb7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.625924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ba3b-2e4e-4cf6-a11a-c68605adb7f9 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.627545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 437/882] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:03.632820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d59516-1448-4d0b-93c9-0bc417b7080f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.633114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d59516-1448-4d0b-93c9-0bc417b7080f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.633389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d59516-1448-4d0b-93c9-0bc417b7080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.651863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f0d59516-1448-4d0b-93c9-0bc417b7080f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:03.653294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f0d59516-1448-4d0b-93c9-0bc417b7080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:03.725437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 446/883] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:03.747946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ba3b-2e4e-4cf6-a11a-c68605adb7f9 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.855964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ba3b-2e4e-4cf6-a11a-c68605adb7f9 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.891894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.892606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.892887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.893154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.893833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.895191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:03.907011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:03.908014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:03.908865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 438/884] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:07:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:03.914385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d59516-1448-4d0b-93c9-0bc417b7080f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.984912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:04.016428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d59516-1448-4d0b-93c9-0bc417b7080f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.049719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.050377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.050659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.050932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.051627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:04.051929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.053335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.058375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 447/885] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:07:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:04.064493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.083417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:04.167293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22427-8cf7-4758-972b-cea6a62984e3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.201042 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.201737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.202155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.202430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.203130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:04.203433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.204794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.210069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 439/886] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:07:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:04.215946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.317661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96febe3f-95c4-454a-bccb-d7ff798a35cf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.358891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e304c0-d743-458c-a0e2-2a01a27ea8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.359578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e304c0-d743-458c-a0e2-2a01a27ea8db None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.359911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e304c0-d743-458c-a0e2-2a01a27ea8db None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.360186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e304c0-d743-458c-a0e2-2a01a27ea8db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.360996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e304c0-d743-458c-a0e2-2a01a27ea8db None admin] RBAC: Adding query filter params (interface=public, service_id=609637ff50914b779f8641fa2d99f7e9, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:04.361309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e304c0-d743-458c-a0e2-2a01a27ea8db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.362738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e304c0-d743-458c-a0e2-2a01a27ea8db None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.364784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:04.369688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 448/887] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:07:04 2022] GET /identity/v3/endpoints?service_id=609637ff50914b779f8641fa2d99f7e9&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:04.375783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.458770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:04.478266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dcbf0-4c4e-4199-af1e-51618f53c21a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.514043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b15fcd-15e8-4c21-b6ba-ccff7012a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.514725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b15fcd-15e8-4c21-b6ba-ccff7012a38d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.515008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b15fcd-15e8-4c21-b6ba-ccff7012a38d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.515283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b15fcd-15e8-4c21-b6ba-ccff7012a38d None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.515980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b15fcd-15e8-4c21-b6ba-ccff7012a38d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.517371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b15fcd-15e8-4c21-b6ba-ccff7012a38d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.524010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 440/888] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:07:04 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:05.185589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8dcb7-967c-403a-9d6e-cb278377c820 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.186115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8dcb7-967c-403a-9d6e-cb278377c820 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.186226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8dcb7-967c-403a-9d6e-cb278377c820 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.187774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 449/889] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:05.192840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc113-64a3-41ab-8a10-0d69c37f0d60 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.193242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc113-64a3-41ab-8a10-0d69c37f0d60 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.193402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc113-64a3-41ab-8a10-0d69c37f0d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.210559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-084fc113-64a3-41ab-8a10-0d69c37f0d60 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:05.211765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-084fc113-64a3-41ab-8a10-0d69c37f0d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:05.280027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 441/890] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:05.304188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8dcb7-967c-403a-9d6e-cb278377c820 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.316103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d51add-0dd4-4407-963b-bc495a744701 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.316635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d51add-0dd4-4407-963b-bc495a744701 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.317573 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d51add-0dd4-4407-963b-bc495a744701 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.319679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 442/891] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:05.326160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c85c5-5110-4e27-9feb-ca87a594db7c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.326640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c85c5-5110-4e27-9feb-ca87a594db7c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.327091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c85c5-5110-4e27-9feb-ca87a594db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.350357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9f6c85c5-5110-4e27-9feb-ca87a594db7c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:05.351128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9f6c85c5-5110-4e27-9feb-ca87a594db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:05.427667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 443/892] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:05.427861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8dcb7-967c-403a-9d6e-cb278377c820 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.449793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c85c5-5110-4e27-9feb-ca87a594db7c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.452779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:05.462849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6ebab-0862-48ab-88cf-2926d93600ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.463929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ebab-0862-48ab-88cf-2926d93600ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.464210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ebab-0862-48ab-88cf-2926d93600ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.464476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ebab-0862-48ab-88cf-2926d93600ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.476382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ebab-0862-48ab-88cf-2926d93600ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-10e6ebab-0862-48ab-88cf-2926d93600ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:05.484993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:05.485984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:05.486855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 450/893] 10.222.0.47 () {56 vars in 1120 bytes} [Thu Jun 30 13:07:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:05.488109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fea32-b37b-44c0-bdee-1615f8e09794 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.488210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fea32-b37b-44c0-bdee-1615f8e09794 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.488414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fea32-b37b-44c0-bdee-1615f8e09794 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.489818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 451/894] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:05.491742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fea32-b37b-44c0-bdee-1615f8e09794 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.555893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:05.562604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c85c5-5110-4e27-9feb-ca87a594db7c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.598607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fea32-b37b-44c0-bdee-1615f8e09794 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.610222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4147c-414f-44df-ada7-6eca86356b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.611026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4147c-414f-44df-ada7-6eca86356b23 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.611306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4147c-414f-44df-ada7-6eca86356b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.611575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4147c-414f-44df-ada7-6eca86356b23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.612215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4147c-414f-44df-ada7-6eca86356b23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.613597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4147c-414f-44df-ada7-6eca86356b23 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-e0d4147c-414f-44df-ada7-6eca86356b23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:05.626048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:05.627034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:05.627882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 444/895] 10.222.0.47 () {56 vars in 1132 bytes} [Thu Jun 30 13:07:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:05.628754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9aec4-a8e3-4bda-85b7-ed12aac919b3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.628754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9aec4-a8e3-4bda-85b7-ed12aac919b3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.628879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9aec4-a8e3-4bda-85b7-ed12aac919b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.640933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.641962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.641962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.642219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.642947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:05.643294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.644646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.647477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-22d9aec4-a8e3-4bda-85b7-ed12aac919b3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:05.648693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-22d9aec4-a8e3-4bda-85b7-ed12aac919b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:05.660273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 452/896] 10.222.0.47 () {56 vars in 1115 bytes} [Thu Jun 30 13:07:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:05.660273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.718180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:05.724098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 445/897] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:05.724901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9aec4-a8e3-4bda-85b7-ed12aac919b3 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.779184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a8530-34d2-48bb-944f-4ac7e59d8b22 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.802335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:05.818734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.819446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.819749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.820120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.820823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:05.821130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.822618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.827520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9aec4-a8e3-4bda-85b7-ed12aac919b3 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.827701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 453/898] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:05.828453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.870854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.871659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.871942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.872217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.884170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.885680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:05.904178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:05.905274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:05.906279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:05.906279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:05.906279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:05.906279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:05.906279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 446/899] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:05.906569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.945739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698efc03-15e5-41e4-bc8c-9e3714d6e909 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.963364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:05.982993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.983684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.983966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.984248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.984961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.986343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.001395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 454/900] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:07:05 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:06.002148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.031951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b211630-4844-4f8d-b24b-bb798fd3aa82 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.058397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.083309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.084461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.085067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.085653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.086593 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:06.087108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.089450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.096279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 447/901] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:06.103091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.132135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720e064-5707-4d07-b277-1f6d8ea46ef1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.172021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.172728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.173020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.173291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.174043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:06.174347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.175711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.190013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 455/902] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:06.195507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.243108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25d5c-4d79-4fa6-90b4-b2e618adf7e9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.254882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.281133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.281975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.282264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.282538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.283401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] RBAC: Adding query filter params (interface=public, service_id=128704a2e062456ea354c2b4e9be8bfd, region_id=RegionOne) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:06.283635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.285275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.290866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 448/903] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/endpoints?service_id=128704a2e062456ea354c2b4e9be8bfd&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:06.296480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.323189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c18e-aabd-46de-aacf-a100f1a3da39 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.326693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.375127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.376726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.377433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.377922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.387207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.389374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:06.408419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:06.409587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:06.410741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:06.418020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7395a-7a1c-48e3-8444-6e7256750660 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.418173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 456/904] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:06.419946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.456134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229428cd-914d-43d5-be81-b152e0dfeeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.456992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229428cd-914d-43d5-be81-b152e0dfeeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.457278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229428cd-914d-43d5-be81-b152e0dfeeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.457635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229428cd-914d-43d5-be81-b152e0dfeeb3 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.458463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229428cd-914d-43d5-be81-b152e0dfeeb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.459824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229428cd-914d-43d5-be81-b152e0dfeeb3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.473649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 449/905] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:06.537066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d6bdf-65cd-4e1c-8d2c-51d0f58232e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.576967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.578080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.578597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.579069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.580121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:06.580635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.582355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.596188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a843-08ec-41ec-87a4-1763efef7b03 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.596521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a843-08ec-41ec-87a4-1763efef7b03 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.596738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a843-08ec-41ec-87a4-1763efef7b03 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.599556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 450/906] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:06.604014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c74ce-1026-4507-984d-384c0322bfbd None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.604299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c74ce-1026-4507-984d-384c0322bfbd None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.604572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c74ce-1026-4507-984d-384c0322bfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.605834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 457/907] 10.222.0.47 () {56 vars in 1149 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:06.613176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.624616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e75c74ce-1026-4507-984d-384c0322bfbd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:06.625835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e75c74ce-1026-4507-984d-384c0322bfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:06.647704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.664516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.721201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 451/908] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:06.738997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c88e0-3498-45e8-bb20-eae1b03ae46f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.744558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c74ce-1026-4507-984d-384c0322bfbd None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.785803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.787324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.787815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.788694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.856519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c74ce-1026-4507-984d-384c0322bfbd None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.909856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.911600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.912111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.912604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.913564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.915132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.924386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.925856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:06.929549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:06.930518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 13:07:06.931363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:06.934157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 452/909] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:06.940686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.977661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.002727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.115754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 458/910] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:07.119310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.143449 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dde571-c193-499e-a064-00a6a6c301d4 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.191391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.192064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.192343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.192611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.193659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:07.193770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.195128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.201553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 453/911] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:07.207024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.278587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa3bb-b1f1-4179-b4b5-3ebebf3a4323 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.326187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.355963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.356790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.357071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.357341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.370208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.371572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.380285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.389151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0a703-d087-4377-a2e7-e4d84039a815 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:07.394660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:07.395635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:07.396531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:07.396531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:07.396531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:07.396531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:07.400839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 459/912] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:07.401686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.433717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.435733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.436249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.436882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.438114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:07.438871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.440591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.450339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 454/913] 10.222.0.47 () {56 vars in 1114 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:07.457505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.523229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0df5-b39f-4ff0-ae6b-99b09da3d418 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.566082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.566987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.567531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.567947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.568912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:07.569359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.571033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.574479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81443-bca3-4974-8895-19a3ce4d3819 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.584486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 460/914] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:07.589929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.616112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.617167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.617296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.617617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.618429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.619985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.628452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.648080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 455/915] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:07:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:07.716323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889341-94e7-4385-8e21-262313071b81 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.762176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.763594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.763881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.764156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.772106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.773593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:07.789179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:07.790186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:07.791062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:07.791967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 461/916] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:07.797532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.821844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.903302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b13ec-8ee4-4bde-a76c-4dcf52e04f3d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.938636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25acc-f94a-4c3b-9fb4-579de4a63167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.939295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25acc-f94a-4c3b-9fb4-579de4a63167 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.939577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25acc-f94a-4c3b-9fb4-579de4a63167 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.939852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25acc-f94a-4c3b-9fb4-579de4a63167 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.940627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25acc-f94a-4c3b-9fb4-579de4a63167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:07.940933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25acc-f94a-4c3b-9fb4-579de4a63167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.942364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25acc-f94a-4c3b-9fb4-579de4a63167 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.955402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 456/917] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:07.961158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.056222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:08.066966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70413e3-49ab-4068-8396-720aa497f788 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.103535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18223496-e177-42cc-9bb1-91209b479fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.104175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223496-e177-42cc-9bb1-91209b479fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.104465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223496-e177-42cc-9bb1-91209b479fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.104740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223496-e177-42cc-9bb1-91209b479fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.105594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18223496-e177-42cc-9bb1-91209b479fc9 None admin] RBAC: Adding query filter params (role.id=d992dd331e8644e7921b02768ef5030b, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=e051cec907124f158a099e1428150e5c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:08.105965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18223496-e177-42cc-9bb1-91209b479fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.108041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18223496-e177-42cc-9bb1-91209b479fc9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.114111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 462/918] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/role_assignments?user.id=e051cec907124f158a099e1428150e5c&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=d992dd331e8644e7921b02768ef5030b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:08.153259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760f01-f5e7-4148-bc01-8efb2f67eaf1 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.154177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760f01-f5e7-4148-bc01-8efb2f67eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.154402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760f01-f5e7-4148-bc01-8efb2f67eaf1 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.155759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 457/919] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:08.161427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a817-79cb-4b6a-aef2-1ca4c0fc1293 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.161765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a817-79cb-4b6a-aef2-1ca4c0fc1293 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.162055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a817-79cb-4b6a-aef2-1ca4c0fc1293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.181033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4071a817-79cb-4b6a-aef2-1ca4c0fc1293 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:08.182295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4071a817-79cb-4b6a-aef2-1ca4c0fc1293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:08.259084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 463/920] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:08.282913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760f01-f5e7-4148-bc01-8efb2f67eaf1 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.372185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:08.402382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760f01-f5e7-4148-bc01-8efb2f67eaf1 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.438662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbb703-2fa3-431b-bc06-a0754f743656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.439390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbb703-2fa3-431b-bc06-a0754f743656 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.439672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbb703-2fa3-431b-bc06-a0754f743656 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.439944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbb703-2fa3-431b-bc06-a0754f743656 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.440662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbb703-2fa3-431b-bc06-a0754f743656 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.442107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbb703-2fa3-431b-bc06-a0754f743656 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-a9fbb703-2fa3-431b-bc06-a0754f743656 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:08.454999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:08.457317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:08.459365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 458/921] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:08.465750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a817-79cb-4b6a-aef2-1ca4c0fc1293 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.554028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:08.570270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a817-79cb-4b6a-aef2-1ca4c0fc1293 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.595579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928b6b8-f87d-45b3-ae49-64303ceeb6e8 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.595579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928b6b8-f87d-45b3-ae49-64303ceeb6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.595579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928b6b8-f87d-45b3-ae49-64303ceeb6e8 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.597360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 459/922] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:08.601335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f18bc-4def-46ac-899e-d69bf72b8e61 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.601896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f18bc-4def-46ac-899e-d69bf72b8e61 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.602397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f18bc-4def-46ac-899e-d69bf72b8e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.606851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.607695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.607980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.608425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.609146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:08.609451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.611754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.617862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 464/923] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:08.621291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b28f18bc-4def-46ac-899e-d69bf72b8e61 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:08.622911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b28f18bc-4def-46ac-899e-d69bf72b8e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:08.623146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.695142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 460/924] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:08.724294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f18bc-4def-46ac-899e-d69bf72b8e61 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.731490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6332de9-4754-45ef-805a-f34f3e7cf30b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.767264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.768208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.768687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.769231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.770132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:08.770615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.772160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.777643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 465/925] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:08.783619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.802033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:08.807379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:08.842876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f18bc-4def-46ac-899e-d69bf72b8e61 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.884122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.884929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.885214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.885512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.886652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.887627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:08.901690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:08.902703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:08.903610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 461/926] 10.222.0.47 () {56 vars in 1132 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:08.908686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.926346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7b10-39e1-423c-aad8-af1616fa0bc8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.974967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.976558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.977337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.977851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.978846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] RBAC: Adding query filter params (interface=public, service_id=2b37a7b5ca214c1eae8161448fea88ab, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:08.979618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.981811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.993406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 466/927] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/endpoints?service_id=2b37a7b5ca214c1eae8161448fea88ab&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:08.993917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:09.022159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c045c-f545-4e50-ab53-82749644b5d7 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:09.058470 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:09.059235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:09.059456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:09.060285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:09.060985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:09.061292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:09.062994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:09.064141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:09.073743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 462/928] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:09.074583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:09.100004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:09.132634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7600-b221-4068-a1cd-ec254cae5ec3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:09.167958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:09.168635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:09.168900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:09.169198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:09.169900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:09.171261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:09.185886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 467/929] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:09.203769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3bb0-2557-4778-b37c-f9d5d4908a60 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:09.244631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1d9e9-6c42-441b-99ce-c86a28d6f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:09.245742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d9e9-6c42-441b-99ce-c86a28d6f4df None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:09.246263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d9e9-6c42-441b-99ce-c86a28d6f4df None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:09.246764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d9e9-6c42-441b-99ce-c86a28d6f4df None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:09.248246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d9e9-6c42-441b-99ce-c86a28d6f4df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:09.248773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d9e9-6c42-441b-99ce-c86a28d6f4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:09.250429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d9e9-6c42-441b-99ce-c86a28d6f4df None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:09.256784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 463/930] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:09.265513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:09.377164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6478-a2aa-4735-bf9e-29e9d34f67d9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:09.412346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f578533-7188-4d39-9004-46b148c2ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:09.413004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f578533-7188-4d39-9004-46b148c2ff3c None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:09.413283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f578533-7188-4d39-9004-46b148c2ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:09.413645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f578533-7188-4d39-9004-46b148c2ff3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:09.414397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f578533-7188-4d39-9004-46b148c2ff3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:09.415753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f578533-7188-4d39-9004-46b148c2ff3c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:09.427683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:09.444547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 468/931] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:07:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:09.843257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c0aee-09f6-4364-a6d5-417c67b50c85 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:09.843795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c0aee-09f6-4364-a6d5-417c67b50c85 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:09.844097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c0aee-09f6-4364-a6d5-417c67b50c85 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:09.845889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 464/932] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:09.851163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3693cf-36c1-4d08-a39c-40dde2803a57 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:09.851586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3693cf-36c1-4d08-a39c-40dde2803a57 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:09.851939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3693cf-36c1-4d08-a39c-40dde2803a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:09.870093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cb3693cf-36c1-4d08-a39c-40dde2803a57 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:09.871293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cb3693cf-36c1-4d08-a39c-40dde2803a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:09.949687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 469/933] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:09.975843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c0aee-09f6-4364-a6d5-417c67b50c85 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:10.043266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:10.085696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c0aee-09f6-4364-a6d5-417c67b50c85 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:10.122512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:10.123147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.123435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.123714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.124430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:10.125896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:10.127322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING keystone.server.flask.common [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 13:07:10.146889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.sql.core [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 13:07:10.146889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 13:07:10.146889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [parameters: {'id': '786122aa0b85425dbed455e4ad9dd096', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 13:07:10.146889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80036) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-6c07deff-c847-4d1d-8dbc-8553881138ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 786122aa0b85425dbed455e4ad9dd096.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 786122aa0b85425dbed455e4ad9dd096. Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application conn.query(q) Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 13:07:10.164961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result.read() Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 30 13:07:10.166855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application next(self.gen) Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application yield resource Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application next(self.gen) Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise self.value Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application session.commit() Jun 30 13:07:10.169107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.session.flush() Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application compat.raise_( Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 13:07:10.171304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 13:07:10.173387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application conn.query(q) Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result.read() Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 13:07:10.179322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [parameters: {'id': '786122aa0b85425dbed455e4ad9dd096', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:10.181519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:10.183414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 786122aa0b85425dbed455e4ad9dd096. Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.189630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 465/934] 10.222.0.47 () {60 vars in 1140 bytes} [Thu Jun 30 13:07:09 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:10.190943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3693cf-36c1-4d08-a39c-40dde2803a57 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:10.257540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47e52b-9f20-42ff-914d-513fe97a46e8 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.257867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47e52b-9f20-42ff-914d-513fe97a46e8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.258088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47e52b-9f20-42ff-914d-513fe97a46e8 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.266596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 466/935] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:10.268021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463588f-6f80-446f-8d3f-2b7eff6162cd None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.268308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463588f-6f80-446f-8d3f-2b7eff6162cd None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.268585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463588f-6f80-446f-8d3f-2b7eff6162cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.282994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3693cf-36c1-4d08-a39c-40dde2803a57 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:10.286553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a463588f-6f80-446f-8d3f-2b7eff6162cd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:10.288041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a463588f-6f80-446f-8d3f-2b7eff6162cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:10.312915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:10.331825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:10.333021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.333323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.333641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.345623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:10.345623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:10.363152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:10.365233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:10.367344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:10.368342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 467/937] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:10.369137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 470/937] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:10.377580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463588f-6f80-446f-8d3f-2b7eff6162cd None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:10.384343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:10.438242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:10.491378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97879232-cb5b-443b-850f-68206e5dc64a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:10.501349 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463588f-6f80-446f-8d3f-2b7eff6162cd None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:10.528562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:10.529770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.530264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.530729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.541790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:10.545012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:10.545737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.546031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.546310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.547066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:10.547375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:10.548931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:10.551949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:10.552879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:10.554067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:10.561272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 471/938] 10.222.0.47 () {56 vars in 1120 bytes} [Thu Jun 30 13:07:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:10.563177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:10.573592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 468/939] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:07:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:10.617532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:10.682412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653624-f7ee-47d3-a47c-ff8c58f11201 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:10.720413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:10.721539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.722060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.722550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.723512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:10.724029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:10.725679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:10.738487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 472/940] 10.222.0.47 () {56 vars in 1115 bytes} [Thu Jun 30 13:07:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:10.744587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:10.852653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd485e32-fde2-43c3-908c-9d76f6054903 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:10.863213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:10.890322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:10.891129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:10.891413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:10.891691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:10.902321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:10.903812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:10.922389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:10.923325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:10.924680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:10.924680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:10.924680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:10.924680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:10.924680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 469/941] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:10.929658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.036285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f9217-47d9-4cd8-969e-c991018c86b9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.038692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:11.072563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441d188-a975-4146-af25-befb6f22349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.073234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441d188-a975-4146-af25-befb6f22349c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.073576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441d188-a975-4146-af25-befb6f22349c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.073858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441d188-a975-4146-af25-befb6f22349c None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.074591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441d188-a975-4146-af25-befb6f22349c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:11.074900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441d188-a975-4146-af25-befb6f22349c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.076404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441d188-a975-4146-af25-befb6f22349c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.089263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 473/942] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:11.095149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.201057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a14a2-c204-4849-a891-506a89477e80 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.237455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c25e-d89d-49ca-ab35-594b32870d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.238300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c25e-d89d-49ca-ab35-594b32870d35 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.238648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c25e-d89d-49ca-ab35-594b32870d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.238932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c25e-d89d-49ca-ab35-594b32870d35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.246276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c25e-d89d-49ca-ab35-594b32870d35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.247778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c25e-d89d-49ca-ab35-594b32870d35 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-9ce6c25e-d89d-49ca-ab35-594b32870d35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:11.269392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:11.270448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:11.271420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:11.274115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 470/943] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:11.280060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441d188-a975-4146-af25-befb6f22349c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.302250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd8d3-f850-445f-ae6a-51afe593f8b3 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.302543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd8d3-f850-445f-ae6a-51afe593f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.302735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd8d3-f850-445f-ae6a-51afe593f8b3 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.304334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 471/944] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:11.309079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c6d96-57dd-4a7f-b317-1df533f284de None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.309365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c6d96-57dd-4a7f-b317-1df533f284de None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.309700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c6d96-57dd-4a7f-b317-1df533f284de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.326181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7a6c6d96-57dd-4a7f-b317-1df533f284de None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:11.327362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7a6c6d96-57dd-4a7f-b317-1df533f284de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:11.347835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:11.392901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441d188-a975-4146-af25-befb6f22349c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.417724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 472/945] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:11.430488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.431170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.431455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.431731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.432635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:11.432948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.434583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.435475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c6d96-57dd-4a7f-b317-1df533f284de None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.454255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 474/946] 10.222.0.47 () {56 vars in 1149 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:11.459830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.487940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:11.546416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c6d96-57dd-4a7f-b317-1df533f284de None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.568827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27cdde-915d-44b8-8db3-34c000b402fb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.582122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2410339-26f9-439f-9c03-c6ce8538e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.582921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2410339-26f9-439f-9c03-c6ce8538e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.583243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2410339-26f9-439f-9c03-c6ce8538e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.583479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2410339-26f9-439f-9c03-c6ce8538e0b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.584126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2410339-26f9-439f-9c03-c6ce8538e0b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.585507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2410339-26f9-439f-9c03-c6ce8538e0b7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-f2410339-26f9-439f-9c03-c6ce8538e0b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:11.598974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:11.599968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:11.600810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 473/947] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:11.601660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f7d4-16a4-42cc-bf33-c484d9eb1eae None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.602226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f7d4-16a4-42cc-bf33-c484d9eb1eae None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.602226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f7d4-16a4-42cc-bf33-c484d9eb1eae None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.605507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 474/948] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:11.606837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f7d4-16a4-42cc-bf33-c484d9eb1eae None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.612303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf17c47-c728-4c7e-b498-2342ad2b6838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.613152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17c47-c728-4c7e-b498-2342ad2b6838 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.613432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17c47-c728-4c7e-b498-2342ad2b6838 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.613733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17c47-c728-4c7e-b498-2342ad2b6838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.623682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:11.623814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf17c47-c728-4c7e-b498-2342ad2b6838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.625245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf17c47-c728-4c7e-b498-2342ad2b6838 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7bf17c47-c728-4c7e-b498-2342ad2b6838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:11.642850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:11.643759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:11.644660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:11.644660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:11.644660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:11.644660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:11.644660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 475/949] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:11.645493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160245ee-d1a7-4aae-b022-c94d898acf34 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.645771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160245ee-d1a7-4aae-b022-c94d898acf34 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.646046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160245ee-d1a7-4aae-b022-c94d898acf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.663655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-160245ee-d1a7-4aae-b022-c94d898acf34 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:11.664817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-160245ee-d1a7-4aae-b022-c94d898acf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:11.722914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f7d4-16a4-42cc-bf33-c484d9eb1eae None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.734241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 476/950] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:11.735253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160245ee-d1a7-4aae-b022-c94d898acf34 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.739307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:11.768927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.769637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.769925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.770206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.770914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:11.771227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.772595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.777500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 475/951] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:11.778275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.845218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160245ee-d1a7-4aae-b022-c94d898acf34 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.866254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:11.880428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.881105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.881387 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.881698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.882438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:11.882748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.884148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.892556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a363e8-64d0-4713-9a1e-d9a4a5b6d6d3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:11.897269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 477/952] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:11.898146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.928054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:11.928841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:11.929123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:11.929394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:11.930069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:11.931424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:11.943603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:11.944631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:11.945502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 476/953] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:11.946715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:11.971767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:12.014539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a5f2-1bf9-4c40-bdd5-8720e3d8b503 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:12.048941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:12.049684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.049968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.050243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.050990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:12.051106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a1ef-42b7-4018-9397-60b0f859bb54 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:12.051297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:12.052792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:12.057794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 478/954] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:12.058556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:12.093869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:12.095179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.095179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.095179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.101990 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:12.103352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:12.117413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:12.118400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 477/955] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:12.119364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:12.123129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:12.166836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b61066-5325-46ca-9917-ac00028c3dac None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:12.198274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:12.207791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:12.208639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.209081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.209361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.210098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:12.210406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:12.211763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:12.217025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 479/956] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:07:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:12.218966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:12.228094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899fedb-cdbb-447d-a81f-74148e21cb2f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:12.264840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:12.265508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.265793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.266068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.266797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:12.268141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:12.297490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 478/957] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:07:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:12.297490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:12.365548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e60e-c3e4-41aa-b993-4fcf3becc761 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:12.370614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:12.413774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:12.414439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.414720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.415062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.415788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:12.416096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:12.417576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:12.425707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a43d4-ec50-4022-958a-103fe8034e18 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:12.437500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 480/958] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:12.439481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:12.474539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586fa4-23a7-46c4-bcc1-37fab8d4b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:12.475207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586fa4-23a7-46c4-bcc1-37fab8d4b545 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.475562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586fa4-23a7-46c4-bcc1-37fab8d4b545 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.475846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586fa4-23a7-46c4-bcc1-37fab8d4b545 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.476708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586fa4-23a7-46c4-bcc1-37fab8d4b545 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:12.477017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586fa4-23a7-46c4-bcc1-37fab8d4b545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:12.479026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586fa4-23a7-46c4-bcc1-37fab8d4b545 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:12.487217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 479/959] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:07:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:12.508177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:12.569921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a8bb3-acbc-42d4-873e-aba3e9e928ef None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:12.611392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2f1b8-1851-4b1a-8328-9f1e7d145168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:12.612235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f1b8-1851-4b1a-8328-9f1e7d145168 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.612506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f1b8-1851-4b1a-8328-9f1e7d145168 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.612781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f1b8-1851-4b1a-8328-9f1e7d145168 None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/e051cec907124f158a099e1428150e5c/roles/d992dd331e8644e7921b02768ef5030b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.615108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2f1b8-1851-4b1a-8328-9f1e7d145168 None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=e051cec907124f158a099e1428150e5c, role_id=d992dd331e8644e7921b02768ef5030b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:12.616554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2f1b8-1851-4b1a-8328-9f1e7d145168 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:12.635357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 481/960] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:07:12 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/e051cec907124f158a099e1428150e5c/roles/d992dd331e8644e7921b02768ef5030b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:12.835650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625b84e-86cd-46de-affb-c6fa96c0e9b5 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.836022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625b84e-86cd-46de-affb-c6fa96c0e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.836225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625b84e-86cd-46de-affb-c6fa96c0e9b5 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.838002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 480/961] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:12.844261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef55f3-7781-4f91-95a1-cecabe5b1db6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:12.844555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef55f3-7781-4f91-95a1-cecabe5b1db6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:12.844835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef55f3-7781-4f91-95a1-cecabe5b1db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:12.863049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-14ef55f3-7781-4f91-95a1-cecabe5b1db6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:12.864162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-14ef55f3-7781-4f91-95a1-cecabe5b1db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:12.936619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 482/962] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:12.961112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625b84e-86cd-46de-affb-c6fa96c0e9b5 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:13.072456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625b84e-86cd-46de-affb-c6fa96c0e9b5 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:13.097476 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:13.109963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:13.110853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:13.111137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:13.111413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:13.112196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:13.113832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:13.130522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.sql.core [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 13:07:13.130522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 13:07:13.130522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [parameters: {'user_id': 'c9f0ff43fc354ccdb22aeecafc70b48f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 13:07:13.130522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80036) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application conn.query(q) Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result.read() Jun 30 13:07:13.138907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 13:07:13.139840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application next(self.gen) Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application yield resource Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application next(self.gen) Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise self.value Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application session.commit() Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 13:07:13.140888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.session.flush() Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application compat.raise_( Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 13:07:13.141882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 13:07:13.142929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application conn.query(q) Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application result.read() Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 13:07:13.143824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c9f0ff43fc354ccdb22aeecafc70b48f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:13.144685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 30 13:07:13.150872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 30 13:07:13.153229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 30 13:07:13.153229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 30 13:07:13.153229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 13:07:13.153229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 13:07:13.153229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 13:07:13.153229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:13.153229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 481/963] 10.222.0.47 () {60 vars in 1131 bytes} [Thu Jun 30 13:07:12 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:13.154795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef55f3-7781-4f91-95a1-cecabe5b1db6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:13.188357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:13.253640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef55f3-7781-4f91-95a1-cecabe5b1db6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:13.288922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8a81b-ac00-4b69-b49d-a70f626394ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:13.289735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8a81b-ac00-4b69-b49d-a70f626394ac None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:13.290019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8a81b-ac00-4b69-b49d-a70f626394ac None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:13.290296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8a81b-ac00-4b69-b49d-a70f626394ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:13.297545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8a81b-ac00-4b69-b49d-a70f626394ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:13.298984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8a81b-ac00-4b69-b49d-a70f626394ac None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-89e8a81b-ac00-4b69-b49d-a70f626394ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:13.313618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:13.315801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:13.318168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 483/964] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:07:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:13.324892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:13.431024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22588-81a2-439c-8ebd-282379ae57ed None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:13.466991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930455ae-4ae0-4ee6-95cf-b7cec4df111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:13.468033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930455ae-4ae0-4ee6-95cf-b7cec4df111c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:13.468536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930455ae-4ae0-4ee6-95cf-b7cec4df111c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:13.469045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930455ae-4ae0-4ee6-95cf-b7cec4df111c None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:13.470101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930455ae-4ae0-4ee6-95cf-b7cec4df111c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:13.470628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930455ae-4ae0-4ee6-95cf-b7cec4df111c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:13.472474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930455ae-4ae0-4ee6-95cf-b7cec4df111c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:13.511447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 482/965] 10.222.0.47 () {56 vars in 1101 bytes} [Thu Jun 30 13:07:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:14.461174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e35434-a6df-41cf-bdff-80e263a3f8a5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.461733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e35434-a6df-41cf-bdff-80e263a3f8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.461733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e35434-a6df-41cf-bdff-80e263a3f8a5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.463267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 484/966] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:14.469075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b04c8-5ca3-4e64-9e3c-2993a2879237 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.469454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b04c8-5ca3-4e64-9e3c-2993a2879237 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.469667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b04c8-5ca3-4e64-9e3c-2993a2879237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.487020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-542b04c8-5ca3-4e64-9e3c-2993a2879237 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:14.488517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-542b04c8-5ca3-4e64-9e3c-2993a2879237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:14.525527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:14.554168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1693-39d6-46c8-9fbb-3de31662bf82 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.555327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1693-39d6-46c8-9fbb-3de31662bf82 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.556938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1693-39d6-46c8-9fbb-3de31662bf82 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.556938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 485/967] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:14.562553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215974-e9fc-4003-96b4-6639f0b149bd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.562842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215974-e9fc-4003-96b4-6639f0b149bd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.563121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215974-e9fc-4003-96b4-6639f0b149bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.568174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 483/968] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:14.579658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3d215974-e9fc-4003-96b4-6639f0b149bd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:14.580859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3d215974-e9fc-4003-96b4-6639f0b149bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:14.585410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b04c8-5ca3-4e64-9e3c-2993a2879237 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:14.650175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 486/969] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:14.673111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215974-e9fc-4003-96b4-6639f0b149bd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:14.690745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b04c8-5ca3-4e64-9e3c-2993a2879237 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:14.701481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:14.726081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:14.726881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.727159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.727426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.728076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:14.729430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:14.741930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:14.743022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:14.743889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 484/970] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:14.749623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:14.778605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215974-e9fc-4003-96b4-6639f0b149bd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:14.784496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:14.812566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187b8d7-2092-4629-a4fe-413483b483ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:14.813218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b8d7-2092-4629-a4fe-413483b483ef None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.813643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b8d7-2092-4629-a4fe-413483b483ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.813921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b8d7-2092-4629-a4fe-413483b483ef None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.814633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187b8d7-2092-4629-a4fe-413483b483ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:14.815995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187b8d7-2092-4629-a4fe-413483b483ef None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:14.829052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 487/971] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:07:14 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:14.830380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18103-7b7b-47d4-a5bf-041c25f9005d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.830673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18103-7b7b-47d4-a5bf-041c25f9005d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.831157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18103-7b7b-47d4-a5bf-041c25f9005d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.833498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 488/972] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:14.838970 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657a3d-60a9-42d7-91dd-52ae8bbb880d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.839701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657a3d-60a9-42d7-91dd-52ae8bbb880d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.840248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657a3d-60a9-42d7-91dd-52ae8bbb880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.851373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027244d-65ba-45f5-a52b-00b09afe0b1d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:14.864815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f2657a3d-60a9-42d7-91dd-52ae8bbb880d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:14.866587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f2657a3d-60a9-42d7-91dd-52ae8bbb880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:14.896009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:14.896694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:14.896976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:14.897250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:14.897998 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:14.898305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:14.899708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:14.905995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 485/973] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:14.911701 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:14.958561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 489/974] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:14.984151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657a3d-60a9-42d7-91dd-52ae8bbb880d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.002885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:15.021848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:15.029108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee911aa-ddce-494e-9318-cbbc779429f6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.065054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.066437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.066934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.067396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.068900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:15.069407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:15.071551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:15.080923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 486/975] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:15.084233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.094196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657a3d-60a9-42d7-91dd-52ae8bbb880d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.131444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.132245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.132523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.132791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.143531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:15.151580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:15.152561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:15.154084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 490/976] 10.222.0.47 () {56 vars in 1120 bytes} [Thu Jun 30 13:07:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:15.159075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.191303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8621-9398-47ed-88f2-758dfd87a247 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.226370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.227026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.227308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.227585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.228381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] RBAC: Adding query filter params (interface=admin, service_id=2b37a7b5ca214c1eae8161448fea88ab, region_id=RegionOne) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:15.228695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:15.230084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:15.236408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 487/977] 10.222.0.47 () {56 vars in 1249 bytes} [Thu Jun 30 13:07:15 2022] GET /identity/v3/endpoints?service_id=2b37a7b5ca214c1eae8161448fea88ab&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:15.240516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:15.241787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.265782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55153a3c-4881-42df-a6bf-7ccb516dca8d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.267329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:15.305143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.305852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.306141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.306420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.307174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:15.307486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:15.308858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:15.318125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 491/978] 10.222.0.47 () {56 vars in 1115 bytes} [Thu Jun 30 13:07:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:15.323375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.352619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a80bcd-a94e-464c-9558-59974342f311 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.390845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.391514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.391801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.392083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.392764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:15.394272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:15.405534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 488/979] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:07:15 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:15.441613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dabe9c-0b07-49e0-a13b-1697e7b5acf3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.480451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.481273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.481612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.481897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.491988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:15.494959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:15.496442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:15.516094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:15.517123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:15.518076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:15.518076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:15.518076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:15.518076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:15.518914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 492/980] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:15.523173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.620754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:15.634352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3c1b-bc4a-4263-a71c-2cc29e683bb6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.668955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.669670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.669952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.670226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:15.671239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:15.672595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:15.686162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 489/981] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:15.691441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.792543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e10c-8b89-46fd-86b8-d0fd43bb730e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:15.826749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:15.827556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:15.827833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:15.828102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:15.835695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:15.837135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:15.852106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:15.853117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 13:07:15.854110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:15.857559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 493/982] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:07:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:15.859056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:15.964748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091b1e0-aacd-4c12-8b2b-da01198fc19d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:16.000032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:16.000705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:16.000989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:16.001266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:16.002817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:16.002817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:16.004963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:16.023357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 490/983] 10.222.0.47 () {56 vars in 1149 bytes} [Thu Jun 30 13:07:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:16.028793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:16.084368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:16.138586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb88e2-0bfa-454b-b4d6-cca3faf9aae5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:16.173944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:16.174590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:16.174875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:16.175153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:16.241837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:16.243312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:16.292893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:16.344599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 494/984] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:16 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:16.351156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:16.360749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:16.454338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab9642-1344-4a08-85d7-7624ab43702c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:16.489916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:16.491137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:16.491708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:16.492202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:16.502913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:16.504833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:16.524497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:16.525946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:16.526857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:16.526857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:16.526857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:16.526857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:16.529624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 491/985] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:16.533202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:16.634126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6569e73-77eb-43ba-897b-dd8f6ce59b0a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:16.667910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:16.668571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:16.668857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:16.669164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:16.669923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:16.670235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:16.671593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:16.682936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 495/986] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:16.688731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:16.746793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:16.789420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dddd24-5bcd-4eb1-8092-3de88805c809 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:16.823778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f650f4-5a1a-4cc9-8a68-08d61b67fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:16.824572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f650f4-5a1a-4cc9-8a68-08d61b67fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:16.824857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f650f4-5a1a-4cc9-8a68-08d61b67fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:16.825132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f650f4-5a1a-4cc9-8a68-08d61b67fd53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:16.831866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f650f4-5a1a-4cc9-8a68-08d61b67fd53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:16.833310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f650f4-5a1a-4cc9-8a68-08d61b67fd53 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-d8f650f4-5a1a-4cc9-8a68-08d61b67fd53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:16.847232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:16.848157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:16.849149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:16.850369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 492/987] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:16.854223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:16.870930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:16.881980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c9ac-ffea-424f-a74c-141c5d65f4bf None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:16.882276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c9ac-ffea-424f-a74c-141c5d65f4bf None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:16.882945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c9ac-ffea-424f-a74c-141c5d65f4bf None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:16.885241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 493/988] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:16.890034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eddde4-c211-4caf-9bb5-9829138c6573 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:16.890324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eddde4-c211-4caf-9bb5-9829138c6573 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:16.890604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eddde4-c211-4caf-9bb5-9829138c6573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:16.907375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c8eddde4-c211-4caf-9bb5-9829138c6573 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:16.908559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c8eddde4-c211-4caf-9bb5-9829138c6573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:16.968835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf7863-8456-43d4-aeba-007bee63a46e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:16.985619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 494/989] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:17.004519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eddde4-c211-4caf-9bb5-9829138c6573 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.007279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.008850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.009141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.009418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.010247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:17.010559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.012087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.025728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 496/990] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:07:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:17.031468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.059325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:17.105406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:17.116996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eddde4-c211-4caf-9bb5-9829138c6573 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.137292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0967ed9-785d-4721-85a2-38bd8ff176b0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.156660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.157450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.157758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.158032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.158682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.160043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:17.172295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:17.173317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:17.179430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:17.180206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.180206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.180206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.180426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 495/991] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:17.180514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.180514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] RBAC: Adding query filter params (role.id=d992dd331e8644e7921b02768ef5030b, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=e051cec907124f158a099e1428150e5c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:17.180514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.180514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.180764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.186622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 497/992] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/role_assignments?user.id=e051cec907124f158a099e1428150e5c&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=d992dd331e8644e7921b02768ef5030b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:17.289882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227938d-bbc2-4461-9537-fd775492dca4 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.305238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:17.328724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8153d05-fd31-4c42-b820-ee68b9784e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.329388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153d05-fd31-4c42-b820-ee68b9784e94 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.329700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153d05-fd31-4c42-b820-ee68b9784e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.329981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153d05-fd31-4c42-b820-ee68b9784e94 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.330692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8153d05-fd31-4c42-b820-ee68b9784e94 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:17.331000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8153d05-fd31-4c42-b820-ee68b9784e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.332362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8153d05-fd31-4c42-b820-ee68b9784e94 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.342337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 496/993] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:17.348230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.445968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5db8e-e9ce-4f01-830c-7d2e3f321af1 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.446148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5db8e-e9ce-4f01-830c-7d2e3f321af1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.446431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5db8e-e9ce-4f01-830c-7d2e3f321af1 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.447796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 497/994] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:17.452885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2536-f6e2-420c-b095-302a1c26b082 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.453173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2536-f6e2-420c-b095-302a1c26b082 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.453450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2536-f6e2-420c-b095-302a1c26b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.456656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c96e95-86b8-46fe-8b0d-37a3c848d7ed None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.470886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ef7d2536-f6e2-420c-b095-302a1c26b082 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:17.472051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ef7d2536-f6e2-420c-b095-302a1c26b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:17.496629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.497324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.497632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.497907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.498722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:17.499229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.500482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.503199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:17.511139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 498/995] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:17.513937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.541086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 498/996] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:17.563624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2536-f6e2-420c-b095-302a1c26b082 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.620342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e4f3-6828-438a-9589-c11569d323ad None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.657200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.657990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.658270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.658564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.659420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] RBAC: Adding query filter params (interface=public, service_id=ac5ccb5d917d41e885518be0754cd1cf, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:17.659729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.661090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.661842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2536-f6e2-420c-b095-302a1c26b082 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.671032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 499/997] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/endpoints?service_id=ac5ccb5d917d41e885518be0754cd1cf&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:17.671195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:17.671987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.702961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.704012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.704305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.704582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.705232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.706632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:17.719883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:17.721080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 13:07:17.722145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:17.726221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 499/998] 10.222.0.47 () {56 vars in 1126 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:17.726909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:17.739150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:17.782778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7505e72-100b-43ef-ba37-ff673d23fe8b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.821129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.821824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.822153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.822446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.823038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.824464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.830773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5d321-2b42-4132-be40-984c0045a825 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:17.831368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 500/999] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:17.876985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:17.877694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:17.877982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:17.878259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:17.878979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:17.879290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:17.880711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:17.891940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 500/1000] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:17.893107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:18.002939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479100b-7f8b-445b-b352-4e770b3b8699 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:18.029140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:18.038191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c11c6-1c98-4c8e-8f33-8f56d5d27f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:18.038856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c11c6-1c98-4c8e-8f33-8f56d5d27f4c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:18.039137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c11c6-1c98-4c8e-8f33-8f56d5d27f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:18.039410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c11c6-1c98-4c8e-8f33-8f56d5d27f4c None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:18.040112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c11c6-1c98-4c8e-8f33-8f56d5d27f4c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:18.040416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c11c6-1c98-4c8e-8f33-8f56d5d27f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:18.041789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c11c6-1c98-4c8e-8f33-8f56d5d27f4c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:18.046877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 501/1001] 10.222.0.47 () {56 vars in 1122 bytes} [Thu Jun 30 13:07:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:18.052239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:18.088240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:18.155523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b648f24-a02a-455f-8a71-ce2ab5e5b8c5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:18.189639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062c76f-aa72-4563-9b47-0a8f8c823ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:18.190298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c76f-aa72-4563-9b47-0a8f8c823ccc None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:18.190627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c76f-aa72-4563-9b47-0a8f8c823ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:18.190904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c76f-aa72-4563-9b47-0a8f8c823ccc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:18.191652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062c76f-aa72-4563-9b47-0a8f8c823ccc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:18.193006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062c76f-aa72-4563-9b47-0a8f8c823ccc None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:18.208558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 501/1002] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:07:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:19.232348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054ea22-5afe-4b46-b4ad-a9be1625619d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:19.232905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054ea22-5afe-4b46-b4ad-a9be1625619d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:19.232905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054ea22-5afe-4b46-b4ad-a9be1625619d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:19.234394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 502/1003] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:19.239295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7734f-e59e-4ef5-8939-04ce01d1268d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:19.239673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7734f-e59e-4ef5-8939-04ce01d1268d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:19.239846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7734f-e59e-4ef5-8939-04ce01d1268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:19.256801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e8b7734f-e59e-4ef5-8939-04ce01d1268d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:19.257995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e8b7734f-e59e-4ef5-8939-04ce01d1268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:19.333584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 502/1004] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:19.354501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054ea22-5afe-4b46-b4ad-a9be1625619d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:19.458457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054ea22-5afe-4b46-b4ad-a9be1625619d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:19.492411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:19.493100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:19.493380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:19.493757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] PATH_INFO: `/v3/services/image` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:19.494405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:19.495759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:19.507219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:19.508221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:19.509069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:19.513385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 503/1005] 10.222.0.47 () {56 vars in 1105 bytes} [Thu Jun 30 13:07:19 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:19.514407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7734f-e59e-4ef5-8939-04ce01d1268d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:19.536347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:19.615492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7734f-e59e-4ef5-8939-04ce01d1268d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:19.648422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592d01f-8446-4b5b-9bc5-23208bd8032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:19.649082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d01f-8446-4b5b-9bc5-23208bd8032a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:19.649363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d01f-8446-4b5b-9bc5-23208bd8032a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:19.649660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d01f-8446-4b5b-9bc5-23208bd8032a None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:19.650360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592d01f-8446-4b5b-9bc5-23208bd8032a None admin] RBAC: Adding query filter params (name=image) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:19.650664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592d01f-8446-4b5b-9bc5-23208bd8032a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:19.652018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592d01f-8446-4b5b-9bc5-23208bd8032a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:19.657411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 503/1006] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:19.662787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:19.719235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:19.764054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124be493-276a-4fd5-a47d-2ede0a49ee1f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:19.797074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8a097-633a-4a33-a7f2-365cd78945aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:19.797745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8a097-633a-4a33-a7f2-365cd78945aa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:19.798026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8a097-633a-4a33-a7f2-365cd78945aa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:19.798300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8a097-633a-4a33-a7f2-365cd78945aa None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:19.798991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8a097-633a-4a33-a7f2-365cd78945aa None admin] RBAC: Adding query filter params (type=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:19.799295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8a097-633a-4a33-a7f2-365cd78945aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:19.800654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8a097-633a-4a33-a7f2-365cd78945aa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:19.805326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 504/1007] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:19.862526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cc0b4-56cb-4d80-a8f4-f9c66376a3d3 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:19.862977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cc0b4-56cb-4d80-a8f4-f9c66376a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:19.863448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cc0b4-56cb-4d80-a8f4-f9c66376a3d3 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:19.866242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 504/1008] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:19.872092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62497f8-0860-4e80-93ec-8570420c35b1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:19.872402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62497f8-0860-4e80-93ec-8570420c35b1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:19.872646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62497f8-0860-4e80-93ec-8570420c35b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:19.891568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d62497f8-0860-4e80-93ec-8570420c35b1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:19.892764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d62497f8-0860-4e80-93ec-8570420c35b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:19.970404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 505/1009] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:19.993114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cc0b4-56cb-4d80-a8f4-f9c66376a3d3 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:20.082776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:20.101693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cc0b4-56cb-4d80-a8f4-f9c66376a3d3 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:20.136406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e2de6-892d-40f4-92a9-9d9547a2634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:20.137221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2de6-892d-40f4-92a9-9d9547a2634b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.137533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2de6-892d-40f4-92a9-9d9547a2634b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.138445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2de6-892d-40f4-92a9-9d9547a2634b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.139095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e2de6-892d-40f4-92a9-9d9547a2634b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:20.140441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e2de6-892d-40f4-92a9-9d9547a2634b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-c04e2de6-892d-40f4-92a9-9d9547a2634b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:20.152164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:20.153173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:20.154111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 505/1010] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:20.160850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62497f8-0860-4e80-93ec-8570420c35b1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:20.210886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:20.261544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62497f8-0860-4e80-93ec-8570420c35b1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:20.266046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922e660-102f-482f-aa7d-8b01f04a8b90 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.266458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922e660-102f-482f-aa7d-8b01f04a8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.266636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922e660-102f-482f-aa7d-8b01f04a8b90 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.268110 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 506/1011] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:20.273153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf6fc4-3a64-4b8b-b335-cc0d53970c3d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.273435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf6fc4-3a64-4b8b-b335-cc0d53970c3d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.273735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf6fc4-3a64-4b8b-b335-cc0d53970c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.291606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0fdf6fc4-3a64-4b8b-b335-cc0d53970c3d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:20.292769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0fdf6fc4-3a64-4b8b-b335-cc0d53970c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:20.297931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:20.298657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.298944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.299271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.300370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] RBAC: Adding query filter params (name=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:20.300705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:20.302463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:20.308310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 506/1012] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:07:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:20.314353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:20.367588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 507/1013] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:20.391395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf6fc4-3a64-4b8b-b335-cc0d53970c3d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:20.425958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf0167-87fe-4fd4-87e3-adc0a8791dff None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:20.445426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:20.468698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:20.469360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.469673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.469956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.470657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:20.470966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:20.472443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:20.474635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:20.478076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 507/1014] 10.222.0.47 () {56 vars in 1112 bytes} [Thu Jun 30 13:07:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:20.483783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:20.496762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf6fc4-3a64-4b8b-b335-cc0d53970c3d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:20.534538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:20.535475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.535756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.536031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.537204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:20.538792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:20.540603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 508/1015] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:20.546423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:20.589888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f60a4d-e9c3-41f6-98d6-1eb027cac058 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:20.625423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ae61-5ca3-42c4-ac90-91cfe4c4b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:20.626035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ae61-5ca3-42c4-ac90-91cfe4c4b263 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.626318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ae61-5ca3-42c4-ac90-91cfe4c4b263 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.626592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ae61-5ca3-42c4-ac90-91cfe4c4b263 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.627321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ae61-5ca3-42c4-ac90-91cfe4c4b263 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:20.628682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ae61-5ca3-42c4-ac90-91cfe4c4b263 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:20.647843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 508/1016] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:07:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:20.662503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a388c-0694-4422-bb7d-3bcdccd57f9d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:20.708312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62aba6-4b42-4674-8966-26f97cb38138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:20.708983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62aba6-4b42-4674-8966-26f97cb38138 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:20.709260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62aba6-4b42-4674-8966-26f97cb38138 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:20.709561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62aba6-4b42-4674-8966-26f97cb38138 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:20.710264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62aba6-4b42-4674-8966-26f97cb38138 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:20.711698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62aba6-4b42-4674-8966-26f97cb38138 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:20.726320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:20.749504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 509/1017] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:07:20 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:21.827628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12b8f-59a8-4da1-9b56-e39e89134a41 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:21.828159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12b8f-59a8-4da1-9b56-e39e89134a41 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:21.828159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12b8f-59a8-4da1-9b56-e39e89134a41 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:21.829790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 509/1018] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:21.835507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13706-25ee-4ea5-af45-b247352e8d8f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:21.836011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13706-25ee-4ea5-af45-b247352e8d8f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:21.836109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13706-25ee-4ea5-af45-b247352e8d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:21.853228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f3c13706-25ee-4ea5-af45-b247352e8d8f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:21.854446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f3c13706-25ee-4ea5-af45-b247352e8d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:21.929621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 510/1019] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:21.948092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12b8f-59a8-4da1-9b56-e39e89134a41 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:21.984251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:22.052887 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12b8f-59a8-4da1-9b56-e39e89134a41 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:22.087038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984f1cc-8633-4ea1-950c-15119a2446ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:22.087788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f1cc-8633-4ea1-950c-15119a2446ae None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:22.088068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f1cc-8633-4ea1-950c-15119a2446ae None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:22.088379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f1cc-8633-4ea1-950c-15119a2446ae None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:22.089431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984f1cc-8633-4ea1-950c-15119a2446ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:22.091099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984f1cc-8633-4ea1-950c-15119a2446ae None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:22.104066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 510/1020] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:07:21 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:22.749747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14576-5580-4804-a4de-013f94a4a799 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:22.750068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14576-5580-4804-a4de-013f94a4a799 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:22.750298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14576-5580-4804-a4de-013f94a4a799 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:22.751843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 511/1021] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:22.756709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d61cb-9c23-4406-babf-88a8539f0fec None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:22.757062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d61cb-9c23-4406-babf-88a8539f0fec None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:22.757407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d61cb-9c23-4406-babf-88a8539f0fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:22.774542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b28d61cb-9c23-4406-babf-88a8539f0fec None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:22.775708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b28d61cb-9c23-4406-babf-88a8539f0fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:22.817697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec991-24e4-4b1e-bada-52c371bf3902 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:22.818029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec991-24e4-4b1e-bada-52c371bf3902 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:22.818261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec991-24e4-4b1e-bada-52c371bf3902 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:22.819768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 512/1022] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:22.824387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e99e5-a101-4bcd-a654-0b303fbacf34 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:22.824678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e99e5-a101-4bcd-a654-0b303fbacf34 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:22.824951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e99e5-a101-4bcd-a654-0b303fbacf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:22.845162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b69e99e5-a101-4bcd-a654-0b303fbacf34 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:22.847024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b69e99e5-a101-4bcd-a654-0b303fbacf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:22.852008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 511/1023] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:22.875299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d61cb-9c23-4406-babf-88a8539f0fec None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:22.898047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:22.917717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 513/1024] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:22.942137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e99e5-a101-4bcd-a654-0b303fbacf34 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:22.985825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d61cb-9c23-4406-babf-88a8539f0fec None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:22.996142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:23.022857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.023595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.023880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.024157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.034932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:23.043072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:23.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:23.044924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 512/1025] 10.222.0.47 () {56 vars in 1120 bytes} [Thu Jun 30 13:07:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:23.048088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e99e5-a101-4bcd-a654-0b303fbacf34 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:23.051063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:23.083473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.084259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.084543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.084815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.085989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:23.087412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:23.093530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 514/1026] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:23.095370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:23.140419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:23.159640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e210a-9c56-4a04-8a3e-be3f73437ad9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:23.193344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.194049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.194335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.194616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.195359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:23.195674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:23.197044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:23.199507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e3736-eaa0-4c40-bea5-347db78cdc27 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:23.206687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 513/1027] 10.222.0.47 () {56 vars in 1115 bytes} [Thu Jun 30 13:07:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:23.212479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:23.225439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:23.239424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.240074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.240358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.240617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.241317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:23.242763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:23.274002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 515/1028] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:07:23 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:23.323819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab128d-3966-4497-bca7-7a10e70c9de1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:23.366672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.367484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.367772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.368046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.380851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:23.382365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:23.384632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:23.402642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:23.403676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:23.404603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:23.404603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:23.404603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:23.404603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:23.404603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 514/1029] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:23.409831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:23.517285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455024-7694-40a9-a9e0-7e2b857b4d41 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:23.551428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.552010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.552290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.552563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.553277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:23.553609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:23.555033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:23.567538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 516/1030] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:23.573253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:23.676203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e790f-2495-4bd0-8479-c062331eb80f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:23.710842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.711676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.711957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.712273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.720132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:23.721602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:23.736182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:23.737164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:07:23.738573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:23.741541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 515/1031] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:07:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:23.743184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:23.785082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:23.850558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b982e8-bc3a-4117-9a45-0088a425092c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:23.889404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66ce66-f8e4-423e-b952-647f05c5ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:23.890382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ce66-f8e4-423e-b952-647f05c5ee83 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:23.890667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ce66-f8e4-423e-b952-647f05c5ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:23.890945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ce66-f8e4-423e-b952-647f05c5ee83 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:23.891781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ce66-f8e4-423e-b952-647f05c5ee83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:23.892092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ce66-f8e4-423e-b952-647f05c5ee83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:23.893542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ce66-f8e4-423e-b952-647f05c5ee83 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:23.916724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 517/1032] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:07:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:23.918114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:23.978653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.024840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de922-2f69-4bef-a5bb-85010ea1be28 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.059562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.060213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.060499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.060774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.132117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.133549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.141321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f486-6eba-4bd0-bac9-bb01b3d36b5c None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.141639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f486-6eba-4bd0-bac9-bb01b3d36b5c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.141922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f486-6eba-4bd0-bac9-bb01b3d36b5c None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.143288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 518/1033] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:24.148230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10caf4d-ad5d-4352-9fa2-7123d2974652 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.148517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10caf4d-ad5d-4352-9fa2-7123d2974652 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.148793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10caf4d-ad5d-4352-9fa2-7123d2974652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.165444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c10caf4d-ad5d-4352-9fa2-7123d2974652 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:24.166635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c10caf4d-ad5d-4352-9fa2-7123d2974652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:24.191795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.240100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 516/1034] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 13:07:24.241407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 519/1035] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:24.245555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.257192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10caf4d-ad5d-4352-9fa2-7123d2974652 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.286317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.355108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeefc5-0f16-4eef-a72e-3e2760d73649 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.362498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10caf4d-ad5d-4352-9fa2-7123d2974652 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.392739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.393447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.393763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.394035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.400574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.401369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.401693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.401973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] PATH_INFO: `/v3/services/image` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.402799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.404559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.405051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.406529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:24.416698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:24.417729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:24.418598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 520/1036] 10.222.0.47 () {56 vars in 1105 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:24.423721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:24.424658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:24.425535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:24.426452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:24.426452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:24.426452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:24.426452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:24.430375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 517/1037] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:24.431202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.440074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.539501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.540934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b56b5-8a5c-4a6b-b9b9-fa6b5a9cf0fd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.551466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5eccb-4aa1-4a58-bed3-d9f22b3cc306 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.579666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.580325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.580610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.580885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.581626 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:24.581936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.583286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.590074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.591490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.591959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.592452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.593353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] RBAC: Adding query filter params (name=image) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:24.593876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.595303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.596151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 518/1038] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:24.604876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 521/1039] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:24.605048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.605918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.675688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.708292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529d747-438f-458f-82fd-ee397817be73 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.715464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097c89-8de5-4915-952c-de6b9a1f2408 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.746708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.747884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.748166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.748438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.749132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:24.749435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.750812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.750915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.751701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.751991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.752271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.756536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 522/1040] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:24.758941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.760371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.762392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:24.775300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:24.776222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:24.781894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 519/1041] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:24.782899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.784015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.868249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3dc0-c222-4c62-abbe-34ecc1234fc9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.889516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa00ab-ac71-4ec2-93e9-366232d9109f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:24.905726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.906387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.906672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.906959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.907844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] RBAC: Adding query filter params (interface=public, service_id=de1b0e27ea4d4d1789c35a5766e245d6, region_id=RegionOne) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:24.908436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.909707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.919828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 523/1042] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/endpoints?service_id=de1b0e27ea4d4d1789c35a5766e245d6&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:24.920841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:24.921776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:24.931537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:24.940795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:24.940795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:24.940795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:24.940795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:24.940795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:24.940795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:24.948981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 520/1043] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:24.956099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:25.020845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:25.041158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3647d2-ba6b-4f63-94a0-de328f471ab0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:25.064556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf236-5b6e-48d0-a92b-84478c95c1af None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:25.077102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3cb6a-fa4c-4a01-9f58-37a8ed37cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:25.077860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3cb6a-fa4c-4a01-9f58-37a8ed37cd43 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.078224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3cb6a-fa4c-4a01-9f58-37a8ed37cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.078545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3cb6a-fa4c-4a01-9f58-37a8ed37cd43 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.079343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3cb6a-fa4c-4a01-9f58-37a8ed37cd43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:25.080692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3cb6a-fa4c-4a01-9f58-37a8ed37cd43 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:25.093675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 524/1044] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:25.100078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd258c2d-1762-40db-81fa-c4cbb238c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:25.100754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258c2d-1762-40db-81fa-c4cbb238c58d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.101038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258c2d-1762-40db-81fa-c4cbb238c58d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.101315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258c2d-1762-40db-81fa-c4cbb238c58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.102222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd258c2d-1762-40db-81fa-c4cbb238c58d None admin] RBAC: Adding query filter params (role.id=d992dd331e8644e7921b02768ef5030b, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=1fe6b95088494836b8598ea8f33d5167) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:25.102540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd258c2d-1762-40db-81fa-c4cbb238c58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:25.104019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd258c2d-1762-40db-81fa-c4cbb238c58d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:25.113511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 521/1045] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:24 2022] GET /identity/v3/role_assignments?user.id=1fe6b95088494836b8598ea8f33d5167&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=d992dd331e8644e7921b02768ef5030b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:25.375797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab63a-d00e-4227-a49b-30a4e57969f5 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.376106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab63a-d00e-4227-a49b-30a4e57969f5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.376359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab63a-d00e-4227-a49b-30a4e57969f5 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.377907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 525/1046] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:25.382856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27dd81-0ff3-4029-ad79-536411b22d08 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.383149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27dd81-0ff3-4029-ad79-536411b22d08 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.383429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27dd81-0ff3-4029-ad79-536411b22d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.399897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4f27dd81-0ff3-4029-ad79-536411b22d08 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:25.401073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4f27dd81-0ff3-4029-ad79-536411b22d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:25.449766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:25.472186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 522/1047] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:25.495926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab63a-d00e-4227-a49b-30a4e57969f5 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:25.599144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab63a-d00e-4227-a49b-30a4e57969f5 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:25.632361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:25.633071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.633352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.633665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.644060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:25.651590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:25.652630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:25.654585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:25.657789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 526/1048] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:07:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:25.659202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27dd81-0ff3-4029-ad79-536411b22d08 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:25.757897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27dd81-0ff3-4029-ad79-536411b22d08 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:25.792314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:25.792985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.793265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.793565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.794350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:25.794659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:25.796014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:25.809016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 523/1049] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:25.810174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:25.818933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:25.913965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84cc91-ffff-4cba-9666-17427883d3d5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:25.946694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:25.947552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.947837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.948111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] PATH_INFO: `/v3/users/a4f7c9292fc74078a31fac45da0821c9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.961741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] RBAC: Authorizing `identity:get_user(user_id=a4f7c9292fc74078a31fac45da0821c9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:25.963180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:25.965271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 527/1050] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:25 2022] GET /identity/v3/users/a4f7c9292fc74078a31fac45da0821c9 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:25.971403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:26.016177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:26.075564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce061-53c1-4f4e-b361-a91bb0bbec4d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:26.111416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:26.112066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:26.112353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:26.112629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:26.181614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:26.182997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:26.229911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:26.289143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 524/1051] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 13:07:26.295179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:26.363674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:26.402920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98931f0-c8d1-4e56-8559-e85c2f6d53fa None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:26.436929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe227afb-c1cf-4063-bfcc-e397dec78c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:26.437737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe227afb-c1cf-4063-bfcc-e397dec78c44 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:26.438017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe227afb-c1cf-4063-bfcc-e397dec78c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:26.438286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe227afb-c1cf-4063-bfcc-e397dec78c44 None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:26.439434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe227afb-c1cf-4063-bfcc-e397dec78c44 None admin] RBAC: Authorizing `identity:get_project(project_id=4386c831e7164a6ba98b4470650521c2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:26.440847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe227afb-c1cf-4063-bfcc-e397dec78c44 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:26.442717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 528/1052] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:26 2022] GET /identity/v3/projects/4386c831e7164a6ba98b4470650521c2 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:26.448667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:26.547807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d587945-c6a0-4e3c-836a-a6210909acca None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:26.581566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c0ac6-c183-463a-abd8-84ba7f26ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:26.582214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c0ac6-c183-463a-abd8-84ba7f26ec94 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:26.582494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c0ac6-c183-463a-abd8-84ba7f26ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:26.582766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c0ac6-c183-463a-abd8-84ba7f26ec94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:26.583581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c0ac6-c183-463a-abd8-84ba7f26ec94 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=4386c831e7164a6ba98b4470650521c2, user.id=a4f7c9292fc74078a31fac45da0821c9) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:26.583889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c0ac6-c183-463a-abd8-84ba7f26ec94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:26.585302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c0ac6-c183-463a-abd8-84ba7f26ec94 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:26.591168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 525/1053] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:26 2022] GET /identity/v3/role_assignments?user.id=a4f7c9292fc74078a31fac45da0821c9&scope.project.id=4386c831e7164a6ba98b4470650521c2&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:27.133015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53eda-ad67-47e3-9540-7b21b43dfe35 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.133585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53eda-ad67-47e3-9540-7b21b43dfe35 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.133585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53eda-ad67-47e3-9540-7b21b43dfe35 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.135004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 529/1054] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:27.140037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e148959-6e4b-4c53-9e44-725cbcdee36b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.140434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e148959-6e4b-4c53-9e44-725cbcdee36b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.140593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e148959-6e4b-4c53-9e44-725cbcdee36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.145438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ef186-82b8-4db5-b904-3a3991e0750c None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.145896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ef186-82b8-4db5-b904-3a3991e0750c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.146178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ef186-82b8-4db5-b904-3a3991e0750c None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.147456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 530/1055] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:27.152443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2fd03-f910-4024-b32b-99a39cf9fb26 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.152733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2fd03-f910-4024-b32b-99a39cf9fb26 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.153014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2fd03-f910-4024-b32b-99a39cf9fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.155349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:27.162592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7e148959-6e4b-4c53-9e44-725cbcdee36b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:27.163997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7e148959-6e4b-4c53-9e44-725cbcdee36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:27.170853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-18b2fd03-f910-4024-b32b-99a39cf9fb26 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:27.172030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-18b2fd03-f910-4024-b32b-99a39cf9fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:27.236426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 526/1056] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:27.240060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 531/1057] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:27.259241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e148959-6e4b-4c53-9e44-725cbcdee36b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.262352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2fd03-f910-4024-b32b-99a39cf9fb26 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.323973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:27.370467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2fd03-f910-4024-b32b-99a39cf9fb26 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.371271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e148959-6e4b-4c53-9e44-725cbcdee36b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.408476 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.409232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.409545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.409824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.410373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.411153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.411437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.411872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] PATH_INFO: `/v3/services/image` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.412813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:27.414208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:27.417326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:27.420430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:27.427419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:27.428477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 13:07:27.429371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:27.430192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:27.431071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:27.431919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:27.432592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 527/1058] 10.222.0.47 () {56 vars in 1105 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:27.436356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.436894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 532/1059] 10.222.0.47 () {56 vars in 1120 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:27.437585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.541884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f457e-eac0-4a79-b6a9-cb92cb8474ff None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.543426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b91849-faaf-46d1-b795-a73633c40b65 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.565731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:27.578065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.578736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.579124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.579404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.579584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.580154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:27.580253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.580463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:27.580558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.580739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.581441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] RBAC: Adding query filter params (name=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:27.581772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:27.581877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:27.583245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:27.595471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 533/1060] 10.222.0.47 () {56 vars in 1115 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:27.595638 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 528/1061] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:27.595729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.596166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.666116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:27.699341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129628-4c9d-4e65-9273-1d3a25a05053 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.708848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814e83f-ea20-4d9d-8a4e-e226f3ce0daa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.735404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.736071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.736356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.736637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.737335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] RBAC: Adding query filter params (type=image) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:27.737685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:27.739031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:27.744220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 534/1062] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:27.746809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.748126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.748412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.748688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.750154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.760712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:27.762196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:27.779587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:27.780481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:27.787017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:27.787017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:27.787017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:27.787017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:27.787017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 529/1063] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:27.787017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:27.800864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:27.855242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524c473-ac8a-42bf-835c-5eb4824fb427 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.889234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.889918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.890205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.890487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.891233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:27.892595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:27.897564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b211-a98b-4e78-9821-7f25c733256f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:27.917570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 535/1064] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:07:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:27.921971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:27.951393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:27.952068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:27.952350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:27.952621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:27.953345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:27.953703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:27.955087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:27.980673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 530/1065] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:27.982508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.093730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff5dea-2e4e-4938-ab34-b5e858eec88c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.096176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:28.131876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.132673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.132957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.133235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.141148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.142643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:28.156596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:28.157612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:28.158608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 536/1066] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:07:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:28.163465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.267411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277dd52-4956-4796-80d8-b5013352e9a9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.302169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.302842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.303127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.303405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.304239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:28.304552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.306044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:28.328158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 531/1067] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:28.329268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.435007 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1a13-b756-4fd3-b107-2a2d03f99ecd None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.469052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82523580-1622-4ac2-a98f-d2adccd84c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.469889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82523580-1622-4ac2-a98f-d2adccd84c5f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.470175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82523580-1622-4ac2-a98f-d2adccd84c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.470450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82523580-1622-4ac2-a98f-d2adccd84c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.482417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82523580-1622-4ac2-a98f-d2adccd84c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.483765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82523580-1622-4ac2-a98f-d2adccd84c5f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-82523580-1622-4ac2-a98f-d2adccd84c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:28.500706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:28.501874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:28.502818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:28.502818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:28.502818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:28.502818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:28.502818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 537/1068] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:28.508950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.539459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:28.587659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd85fd-a413-44d3-b577-c6ce4ce3a363 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.587991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd85fd-a413-44d3-b577-c6ce4ce3a363 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.588213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd85fd-a413-44d3-b577-c6ce4ce3a363 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.589985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 538/1069] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:28.595338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ddf9b-a796-4ffc-a9c3-1fdfb82d1721 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.595635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ddf9b-a796-4ffc-a9c3-1fdfb82d1721 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.595916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ddf9b-a796-4ffc-a9c3-1fdfb82d1721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.612894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e50ddf9b-a796-4ffc-a9c3-1fdfb82d1721 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:28.613142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612b14-a8bb-412d-a1d1-195f22d92a74 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.614078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e50ddf9b-a796-4ffc-a9c3-1fdfb82d1721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:28.624848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:28.651987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.653013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.654004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.654294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.655039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:28.655361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.656733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:28.668348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 532/1070] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:28.674431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.687224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 539/1071] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:28.709510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ddf9b-a796-4ffc-a9c3-1fdfb82d1721 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.766718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:28.777300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dd51b-f83f-4028-848a-26927c15b9d4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.813852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ddf9b-a796-4ffc-a9c3-1fdfb82d1721 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.815426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.816936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.817227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.817536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.825996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.827709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:28.844170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:28.845052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:28.846492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 533/1072] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:28.851153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.851820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.852606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.852888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.853163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.865500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:28.873051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:28.874031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:28.874885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 540/1073] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:28.880617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.890761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:28.961219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35387-6b47-4b60-92c7-cfc683ce378c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.986458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa6cc5-71a9-47fc-a483-454caf121912 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.997062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.997792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.998085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.998359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.999142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:28.999455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.000872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.013987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 534/1074] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:29.019863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.022233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.022900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.023182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.023455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.024199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:29.024506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.025893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.034436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:29.035475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 541/1075] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:29.041385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.113454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:29.135338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606cea-0571-4bba-97bd-56f81b8dc1ca None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.149486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d1ca3-98ca-45d6-abde-ebe6b722239c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.171050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.171930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.172209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.172479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/1fe6b95088494836b8598ea8f33d5167/roles/d992dd331e8644e7921b02768ef5030b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.174707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=1fe6b95088494836b8598ea8f33d5167, role_id=d992dd331e8644e7921b02768ef5030b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.176141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.186112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.186992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.187269 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.187543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] PATH_INFO: `/v3/users/a4f7c9292fc74078a31fac45da0821c9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.188735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] RBAC: Authorizing `identity:get_user(user_id=a4f7c9292fc74078a31fac45da0821c9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.190202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 535/1076] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:07:29 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/1fe6b95088494836b8598ea8f33d5167/roles/d992dd331e8644e7921b02768ef5030b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:29.190324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.196710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 542/1077] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:29 2022] GET /identity/v3/users/a4f7c9292fc74078a31fac45da0821c9 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:29.197770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.274124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:29.309995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425c021-3652-429c-acf1-fe17814eb8ed None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.352893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91630856-ebe1-4f57-860e-fa39e70c2fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.354282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91630856-ebe1-4f57-860e-fa39e70c2fcd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.354282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91630856-ebe1-4f57-860e-fa39e70c2fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.354482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91630856-ebe1-4f57-860e-fa39e70c2fcd None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.356615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91630856-ebe1-4f57-860e-fa39e70c2fcd None admin] RBAC: Authorizing `identity:get_project(project_id=4386c831e7164a6ba98b4470650521c2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.358316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91630856-ebe1-4f57-860e-fa39e70c2fcd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.359609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 536/1078] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:29 2022] GET /identity/v3/projects/4386c831e7164a6ba98b4470650521c2 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:29.365674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.464690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039a2c-6b12-4f15-8218-82b85f6c43e3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.497697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31123c2a-fcfa-48ba-9b00-c609b545adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.498585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31123c2a-fcfa-48ba-9b00-c609b545adb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.498870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31123c2a-fcfa-48ba-9b00-c609b545adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.499140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31123c2a-fcfa-48ba-9b00-c609b545adb2 None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2/users/a4f7c9292fc74078a31fac45da0821c9/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.501074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31123c2a-fcfa-48ba-9b00-c609b545adb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4386c831e7164a6ba98b4470650521c2, user_id=a4f7c9292fc74078a31fac45da0821c9, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.502529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31123c2a-fcfa-48ba-9b00-c609b545adb2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.505662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:29.520134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 543/1079] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:07:29 2022] PUT /identity/v3/projects/4386c831e7164a6ba98b4470650521c2/users/a4f7c9292fc74078a31fac45da0821c9/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:30.010613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071bc96-6259-40ed-9cf8-f902ffddacd3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:30.010965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071bc96-6259-40ed-9cf8-f902ffddacd3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:30.011183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071bc96-6259-40ed-9cf8-f902ffddacd3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:30.012754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 537/1080] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:30.017716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800950-2fbf-4a90-86de-de1eb66299f0 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:30.018071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800950-2fbf-4a90-86de-de1eb66299f0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:30.018421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800950-2fbf-4a90-86de-de1eb66299f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:30.035589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-70800950-2fbf-4a90-86de-de1eb66299f0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:30.036753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-70800950-2fbf-4a90-86de-de1eb66299f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:30.109497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 544/1081] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:30.132206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071bc96-6259-40ed-9cf8-f902ffddacd3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:30.237043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071bc96-6259-40ed-9cf8-f902ffddacd3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:30.271243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:30.271820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:30.272102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:30.272380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:30.281692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:30.350488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:30.352169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:30.452108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 538/1082] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:30.457799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800950-2fbf-4a90-86de-de1eb66299f0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:30.553719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800950-2fbf-4a90-86de-de1eb66299f0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:30.579298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:30.589207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fafad5-5f7c-4c8c-88a6-4f6db7fde45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:30.590034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fafad5-5f7c-4c8c-88a6-4f6db7fde45f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:30.590319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fafad5-5f7c-4c8c-88a6-4f6db7fde45f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:30.591185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fafad5-5f7c-4c8c-88a6-4f6db7fde45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:30.602103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fafad5-5f7c-4c8c-88a6-4f6db7fde45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:30.603584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fafad5-5f7c-4c8c-88a6-4f6db7fde45f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-97fafad5-5f7c-4c8c-88a6-4f6db7fde45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:30.622972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:30.623937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:30.624846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:30.624846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:30.624846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:30.624846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:30.624846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 545/1083] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:30.630277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:30.671465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:30.732886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb09dc-fdf1-4d0b-b963-615aa02c05bb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:30.767312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a9b9d-229b-460d-b388-45aea8c08779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:30.767976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a9b9d-229b-460d-b388-45aea8c08779 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:30.768259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a9b9d-229b-460d-b388-45aea8c08779 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:30.768530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a9b9d-229b-460d-b388-45aea8c08779 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:30.769247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a9b9d-229b-460d-b388-45aea8c08779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:30.769582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a9b9d-229b-460d-b388-45aea8c08779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:30.770951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a9b9d-229b-460d-b388-45aea8c08779 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:30.789495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 539/1084] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:31.228886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd765-7347-4cac-a0bf-d95cfc4bc520 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.229166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd765-7347-4cac-a0bf-d95cfc4bc520 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.229438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd765-7347-4cac-a0bf-d95cfc4bc520 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.230847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 546/1085] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:31.236550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdc3bf-79bf-41d9-b6ca-596bd1fe288b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.236915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdc3bf-79bf-41d9-b6ca-596bd1fe288b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.237267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdc3bf-79bf-41d9-b6ca-596bd1fe288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.254384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a3fdc3bf-79bf-41d9-b6ca-596bd1fe288b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:31.255567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a3fdc3bf-79bf-41d9-b6ca-596bd1fe288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:31.321574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 540/1086] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:31.345796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fd765-7347-4cac-a0bf-d95cfc4bc520 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.444551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fd765-7347-4cac-a0bf-d95cfc4bc520 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:31.477214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedebcb-b961-4b5d-82ee-cc2c1df02a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:31.478038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedebcb-b961-4b5d-82ee-cc2c1df02a63 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.478317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedebcb-b961-4b5d-82ee-cc2c1df02a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.478589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedebcb-b961-4b5d-82ee-cc2c1df02a63 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.489024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedebcb-b961-4b5d-82ee-cc2c1df02a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-dbedebcb-b961-4b5d-82ee-cc2c1df02a63 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:31.497108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:31.498303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:31.499182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 547/1087] 10.222.0.47 () {56 vars in 1120 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:31.504327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdc3bf-79bf-41d9-b6ca-596bd1fe288b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.517765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97519d8b-c60c-4405-9887-6cfdadf18da7 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.518052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97519d8b-c60c-4405-9887-6cfdadf18da7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.518328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97519d8b-c60c-4405-9887-6cfdadf18da7 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.519662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 548/1088] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:07:31.524526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf026-2ad7-4017-9b68-cebd5c68e55e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.524812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf026-2ad7-4017-9b68-cebd5c68e55e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.525088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf026-2ad7-4017-9b68-cebd5c68e55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.532943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:31.542306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a9fcf026-2ad7-4017-9b68-cebd5c68e55e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:31.543481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a9fcf026-2ad7-4017-9b68-cebd5c68e55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:31.573052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:31.605699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdc3bf-79bf-41d9-b6ca-596bd1fe288b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:31.611232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 549/1089] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:31.634107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf026-2ad7-4017-9b68-cebd5c68e55e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.639317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:31.639978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.640258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.640527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.641261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:31.641610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:31.642956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:31.655909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 541/1090] 10.222.0.47 () {56 vars in 1115 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:31.656853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.731361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf026-2ad7-4017-9b68-cebd5c68e55e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:31.744823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:31.755044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6e7a7-4029-4091-b82b-f99a7c5abe38 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:31.766625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:31.767411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.767696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.767984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.778003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:31.785627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:31.786563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:31.787431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 550/1091] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:31.788135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:31.788647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.788819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.789094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.792659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.800080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:31.801532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:31.819213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:31.820222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:31.821121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:31.821121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:31.821121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:31.821121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:31.821121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 542/1092] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:31.822931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:31.826013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.893275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3605f58-fc9d-4995-9b7a-d53d66611a39 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:31.924262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629d2f-22b4-4c21-9320-5ff62829c57f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:31.925886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:31.926553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.926838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.927117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.927858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:31.928166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:31.929551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:31.938925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 551/1093] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:31.944576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.961124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:31.961806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:31.962093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:31.962368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:31.963081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:31.963384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:31.964994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:31.977314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 543/1094] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:31.982765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:31.985791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.039383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.049195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e896d-cfe3-4b4f-9e74-a87d8eeec7a4 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.081392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d2768-3f06-43c5-9649-0f40932e1d4e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.083376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.084241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.084519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.084790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] PATH_INFO: `/v3/users/a4f7c9292fc74078a31fac45da0821c9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.086027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] RBAC: Authorizing `identity:get_user(user_id=a4f7c9292fc74078a31fac45da0821c9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.087516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.094542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 552/1095] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/users/a4f7c9292fc74078a31fac45da0821c9 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:32.095683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:32.121331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.122639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.122927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.123209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.131792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.133232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:07:32.148054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:32.149211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:32.150420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 544/1096] 10.222.0.47 () {56 vars in 1093 bytes} [Thu Jun 30 13:07:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:32.154791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:32.195811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6f96-2466-435b-a279-4a58d5960a78 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.215547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.229189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.229874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.230153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.230423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.254522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a4be-0ac3-4578-8040-cf805eb91b21 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.256478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.288365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.289025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.289309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.289678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.290464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:32.290778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.292202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.297320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.298800 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.310766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 545/1097] 10.222.0.47 () {56 vars in 1133 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:32.316348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:32.399129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 553/1098] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 13:07:32.404723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:32.415432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dbeba-e2cb-4d26-98c5-e21f2d863d5d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.435503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.449611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.450835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.451116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.451390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.460715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.501842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e936c-01ae-47db-b4a5-8945c20b94f3 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.517636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.519079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.535100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.535947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.536240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.536519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.537729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] RBAC: Authorizing `identity:get_project(project_id=4386c831e7164a6ba98b4470650521c2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.539145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.540926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 554/1099] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/projects/4386c831e7164a6ba98b4470650521c2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:32.547238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:32.620041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 546/1100] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:32.626212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:32.645781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.645953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ddffc-c476-4677-9e60-c861682379a0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.673832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.682937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.683575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.683855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.684148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.685663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=4386c831e7164a6ba98b4470650521c2, user.id=a4f7c9292fc74078a31fac45da0821c9) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:32.685988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.687400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.693150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 555/1101] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/role_assignments?user.id=a4f7c9292fc74078a31fac45da0821c9&scope.project.id=4386c831e7164a6ba98b4470650521c2&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:32.725228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e00f9-f0ed-4ae3-a6b6-52984a900989 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.762185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.763017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.763294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.763561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.774569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.776045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:07:32.794939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:32.796055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:32.796996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:07:32.796996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:07:32.796996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:07:32.796996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:32.796996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 547/1102] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:32.802170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:32.904815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb86f-f17b-425a-bcc9-21cb9c8147f8 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:32.937670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:32.938321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:32.938605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:32.938882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:32.939597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:32.939904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:32.941264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:32.952670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 556/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:32.958208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:33.030506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:33.060456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab156-a52e-452d-9a7c-e25f3445b7d2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:33.095390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:33.096172 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:33.096456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:33.096729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:33.103284 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:33.104720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:07:33.118785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:33.119816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:33.121099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 548/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:07:33.125804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:33.174796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:33.224076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc47bf-e80d-46b9-a2bf-05ab1cca1356 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:33.256531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfccea-1662-4d59-a152-d1851b548852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:33.257175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfccea-1662-4d59-a152-d1851b548852 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:33.257454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfccea-1662-4d59-a152-d1851b548852 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:33.257750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfccea-1662-4d59-a152-d1851b548852 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:33.258548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfccea-1662-4d59-a152-d1851b548852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:33.258852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfccea-1662-4d59-a152-d1851b548852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:33.260257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfccea-1662-4d59-a152-d1851b548852 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:33.272050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 557/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:33.278904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:33.375677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632694ad-b0c2-4b69-82fc-186db67c65de None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:33.404906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:33.410323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be418b2-4ba3-428f-b1b5-21b81ff39314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:33.410976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be418b2-4ba3-428f-b1b5-21b81ff39314 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:33.411261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be418b2-4ba3-428f-b1b5-21b81ff39314 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:33.411540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be418b2-4ba3-428f-b1b5-21b81ff39314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:33.412367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be418b2-4ba3-428f-b1b5-21b81ff39314 None admin] RBAC: Adding query filter params (role.id=d992dd331e8644e7921b02768ef5030b, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=1fe6b95088494836b8598ea8f33d5167) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:33.412680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be418b2-4ba3-428f-b1b5-21b81ff39314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:33.414146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be418b2-4ba3-428f-b1b5-21b81ff39314 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:33.419980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 549/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:33 2022] GET /identity/v3/role_assignments?user.id=1fe6b95088494836b8598ea8f33d5167&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=d992dd331e8644e7921b02768ef5030b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:34.705763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b06f9-a499-458a-9a44-07caaea29aee None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:34.706277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b06f9-a499-458a-9a44-07caaea29aee None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:34.706277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b06f9-a499-458a-9a44-07caaea29aee None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:34.707637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 558/1107] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:34.712800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f77e9-1ea0-4dbc-bd94-606f8df56711 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:34.713219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f77e9-1ea0-4dbc-bd94-606f8df56711 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:34.713360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f77e9-1ea0-4dbc-bd94-606f8df56711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:34.730501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-df9f77e9-1ea0-4dbc-bd94-606f8df56711 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:34.732325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-df9f77e9-1ea0-4dbc-bd94-606f8df56711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:34.796827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 550/1108] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:07:34.821014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b06f9-a499-458a-9a44-07caaea29aee None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:34.919530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b06f9-a499-458a-9a44-07caaea29aee None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:34.929407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:34.952452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8487-cc60-4e36-927d-85874cf76c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:34.953230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8487-cc60-4e36-927d-85874cf76c2d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:34.953543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8487-cc60-4e36-927d-85874cf76c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:34.953826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8487-cc60-4e36-927d-85874cf76c2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:34.954985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8487-cc60-4e36-927d-85874cf76c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:34.956463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8487-cc60-4e36-927d-85874cf76c2d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:34.958053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 559/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:34.963785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f77e9-1ea0-4dbc-bd94-606f8df56711 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.060493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f77e9-1ea0-4dbc-bd94-606f8df56711 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.085053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:35.095427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56a47-197a-4177-9fc5-eef43b639411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.096075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56a47-197a-4177-9fc5-eef43b639411 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.096356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56a47-197a-4177-9fc5-eef43b639411 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.096627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56a47-197a-4177-9fc5-eef43b639411 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.097335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a56a47-197a-4177-9fc5-eef43b639411 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.098777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a56a47-197a-4177-9fc5-eef43b639411 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.117696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 551/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:07:34 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:37.157761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83a4e-9fb4-482b-8fa9-8a5038a4e029 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.158299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83a4e-9fb4-482b-8fa9-8a5038a4e029 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.158299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83a4e-9fb4-482b-8fa9-8a5038a4e029 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.159685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 560/1111] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:37.164773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce550a93-7c96-43e5-8166-5a887e68f9d5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.165175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce550a93-7c96-43e5-8166-5a887e68f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.165330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce550a93-7c96-43e5-8166-5a887e68f9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.182316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ce550a93-7c96-43e5-8166-5a887e68f9d5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:37.183492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ce550a93-7c96-43e5-8166-5a887e68f9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:37.248082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 552/1112] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:37.271234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83a4e-9fb4-482b-8fa9-8a5038a4e029 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.370697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83a4e-9fb4-482b-8fa9-8a5038a4e029 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.402560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.403926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.404204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.404474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] PATH_INFO: `/v3/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.405947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] RBAC: Authorizing `identity:get_role(role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.407297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.408706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 561/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:37.414321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce550a93-7c96-43e5-8166-5a887e68f9d5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.509752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce550a93-7c96-43e5-8166-5a887e68f9d5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.522367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:37.544762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.545656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.545942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.546217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] PATH_INFO: `/v3/users/d9f9f4413d524193afb6d88e3b88f5df` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.558817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] RBAC: Authorizing `identity:get_user(user_id=d9f9f4413d524193afb6d88e3b88f5df)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.560283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.561933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 553/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/users/d9f9f4413d524193afb6d88e3b88f5df => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:37.567473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.612958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:37.663852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1e080-7531-40dc-9ff9-a660bf564b60 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.695706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.696333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.696614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.696886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.760628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.762098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.805298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:37.856828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 562/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:37.862521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.958374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834835b-b07f-4d3d-96c6-8c7c71a0ea64 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.991003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d704c9-cd5f-47f3-8138-7603cf6f6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.991839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d704c9-cd5f-47f3-8138-7603cf6f6d7e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.992118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d704c9-cd5f-47f3-8138-7603cf6f6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.992389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d704c9-cd5f-47f3-8138-7603cf6f6d7e None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.993557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d704c9-cd5f-47f3-8138-7603cf6f6d7e None admin] RBAC: Authorizing `identity:get_project(project_id=4386c831e7164a6ba98b4470650521c2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.994975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d704c9-cd5f-47f3-8138-7603cf6f6d7e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.996619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 554/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/projects/4386c831e7164a6ba98b4470650521c2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:38.002604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:38.099063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb3a6-6c1a-42c7-b616-e6beda7f3452 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:38.132400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182579aa-7504-4e29-a3eb-7bb59dde6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:38.133039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182579aa-7504-4e29-a3eb-7bb59dde6b51 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.133321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182579aa-7504-4e29-a3eb-7bb59dde6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.133625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182579aa-7504-4e29-a3eb-7bb59dde6b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.134450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182579aa-7504-4e29-a3eb-7bb59dde6b51 None admin] RBAC: Adding query filter params (role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=4386c831e7164a6ba98b4470650521c2, user.id=d9f9f4413d524193afb6d88e3b88f5df) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:38.134763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182579aa-7504-4e29-a3eb-7bb59dde6b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:38.136194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182579aa-7504-4e29-a3eb-7bb59dde6b51 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:38.142145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 563/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:38 2022] GET /identity/v3/role_assignments?user.id=d9f9f4413d524193afb6d88e3b88f5df&scope.project.id=4386c831e7164a6ba98b4470650521c2&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:40.114739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14831fc-f21f-4a5e-a469-df09b7de52d5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.115272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14831fc-f21f-4a5e-a469-df09b7de52d5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.115272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14831fc-f21f-4a5e-a469-df09b7de52d5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.116651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 555/1118] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:40.122354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a8952-1c7b-4ebe-beec-dc6a9e7b6688 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.122777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a8952-1c7b-4ebe-beec-dc6a9e7b6688 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.122906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a8952-1c7b-4ebe-beec-dc6a9e7b6688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.139041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-eb2a8952-1c7b-4ebe-beec-dc6a9e7b6688 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:40.140213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-eb2a8952-1c7b-4ebe-beec-dc6a9e7b6688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:40.142900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:40.205533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 564/1119] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:40.228128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14831fc-f21f-4a5e-a469-df09b7de52d5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.268721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:40.327667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14831fc-f21f-4a5e-a469-df09b7de52d5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.361069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.361957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.362241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.362516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] PATH_INFO: `/v3/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.363993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] RBAC: Authorizing `identity:get_role(role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.365405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.366759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 556/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:40 2022] GET /identity/v3/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:40.373127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a8952-1c7b-4ebe-beec-dc6a9e7b6688 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.467836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a8952-1c7b-4ebe-beec-dc6a9e7b6688 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.500155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.500992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.501270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.501570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] PATH_INFO: `/v3/users/d9f9f4413d524193afb6d88e3b88f5df` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.502734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] RBAC: Authorizing `identity:get_user(user_id=d9f9f4413d524193afb6d88e3b88f5df)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.504144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.505753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 565/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:40 2022] GET /identity/v3/users/d9f9f4413d524193afb6d88e3b88f5df => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:40.511531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.608466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0d4f-03d7-46b7-a510-50f7bedfab91 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.615550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:40.641537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281b912-9bf6-4011-a02a-2de298942efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.642371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281b912-9bf6-4011-a02a-2de298942efe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.642653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281b912-9bf6-4011-a02a-2de298942efe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.642925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281b912-9bf6-4011-a02a-2de298942efe None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.644083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281b912-9bf6-4011-a02a-2de298942efe None admin] RBAC: Authorizing `identity:get_project(project_id=4386c831e7164a6ba98b4470650521c2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.645522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281b912-9bf6-4011-a02a-2de298942efe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.647179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 557/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:40 2022] GET /identity/v3/projects/4386c831e7164a6ba98b4470650521c2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:40.653874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.664267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:40.750114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a03a1b-42f6-4d70-92f9-3eda3fcb30d9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.782932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d58642-8ce2-4a03-9f60-0090a95c7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.783800 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58642-8ce2-4a03-9f60-0090a95c7d5d None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.784081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58642-8ce2-4a03-9f60-0090a95c7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.784352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58642-8ce2-4a03-9f60-0090a95c7d5d None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2/users/d9f9f4413d524193afb6d88e3b88f5df/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.786550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d58642-8ce2-4a03-9f60-0090a95c7d5d None admin] RBAC: Authorizing `identity:create_grant(project_id=4386c831e7164a6ba98b4470650521c2, user_id=d9f9f4413d524193afb6d88e3b88f5df, role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.787963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d58642-8ce2-4a03-9f60-0090a95c7d5d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.799935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 566/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:07:40 2022] PUT /identity/v3/projects/4386c831e7164a6ba98b4470650521c2/users/d9f9f4413d524193afb6d88e3b88f5df/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:42.770190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308fcbe-f9ed-4a2e-a869-8bc5f3eaa475 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:42.770697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308fcbe-f9ed-4a2e-a869-8bc5f3eaa475 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:42.770802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308fcbe-f9ed-4a2e-a869-8bc5f3eaa475 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:42.772086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 558/1124] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:42.777172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525b36d-a391-40f1-b779-a47632e10615 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:42.777562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525b36d-a391-40f1-b779-a47632e10615 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:42.777754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525b36d-a391-40f1-b779-a47632e10615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:42.794083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b525b36d-a391-40f1-b779-a47632e10615 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:42.795262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b525b36d-a391-40f1-b779-a47632e10615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:42.854643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:42.860739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 567/1125] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:42.884132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308fcbe-f9ed-4a2e-a869-8bc5f3eaa475 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:42.982220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308fcbe-f9ed-4a2e-a869-8bc5f3eaa475 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:43.015236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:43.016071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:43.016353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:43.016628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] PATH_INFO: `/v3/roles/3712dd93aa1446b5bf848c6bbab09c56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:43.018102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] RBAC: Authorizing `identity:get_role(role_id=3712dd93aa1446b5bf848c6bbab09c56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:43.019461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:43.020829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 559/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:42 2022] GET /identity/v3/roles/3712dd93aa1446b5bf848c6bbab09c56 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:43.026331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525b36d-a391-40f1-b779-a47632e10615 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:43.121014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525b36d-a391-40f1-b779-a47632e10615 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:43.153345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:43.154212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:43.154491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:43.154763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] PATH_INFO: `/v3/users/d9f9f4413d524193afb6d88e3b88f5df` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:43.155932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] RBAC: Authorizing `identity:get_user(user_id=d9f9f4413d524193afb6d88e3b88f5df)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:43.157354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:43.158971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 568/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:43 2022] GET /identity/v3/users/d9f9f4413d524193afb6d88e3b88f5df => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:43.164390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:43.206564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:43.260762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500f1a4-31d2-4236-bbda-83a09ca56f18 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:43.294043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:43.294607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:43.294889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:43.295161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:43.360125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:43.361604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:43.401684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:43.457117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 560/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:43.462931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:43.525731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:43.558808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b759c-a924-42ff-8dde-1f36d4b5fabc None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:43.591668 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdb81f-9387-443a-83fe-bf2f6875f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:43.592499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdb81f-9387-443a-83fe-bf2f6875f29e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:43.592779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdb81f-9387-443a-83fe-bf2f6875f29e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:43.593050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdb81f-9387-443a-83fe-bf2f6875f29e None admin] PATH_INFO: `/v3/projects/4386c831e7164a6ba98b4470650521c2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:43.594222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdb81f-9387-443a-83fe-bf2f6875f29e None admin] RBAC: Authorizing `identity:get_project(project_id=4386c831e7164a6ba98b4470650521c2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:43.595638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdb81f-9387-443a-83fe-bf2f6875f29e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:43.597281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 569/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:43 2022] GET /identity/v3/projects/4386c831e7164a6ba98b4470650521c2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:43.603239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:43.697842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0280e0-b169-4ad2-a5a5-90659e1646b4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:43.730671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16140a22-e4be-431e-a8fe-b91da16f150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:43.731329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16140a22-e4be-431e-a8fe-b91da16f150c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:43.731607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16140a22-e4be-431e-a8fe-b91da16f150c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:43.731881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16140a22-e4be-431e-a8fe-b91da16f150c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:43.732695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16140a22-e4be-431e-a8fe-b91da16f150c None admin] RBAC: Adding query filter params (role.id=3712dd93aa1446b5bf848c6bbab09c56, scope.project.id=4386c831e7164a6ba98b4470650521c2, user.id=d9f9f4413d524193afb6d88e3b88f5df) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:43.733005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16140a22-e4be-431e-a8fe-b91da16f150c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:43.734433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16140a22-e4be-431e-a8fe-b91da16f150c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:43.740046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 561/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:43 2022] GET /identity/v3/role_assignments?user.id=d9f9f4413d524193afb6d88e3b88f5df&scope.project.id=4386c831e7164a6ba98b4470650521c2&role.id=3712dd93aa1446b5bf848c6bbab09c56 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:45.763302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625169-ecb3-456e-8aa5-332257d89719 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.763889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625169-ecb3-456e-8aa5-332257d89719 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.763889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625169-ecb3-456e-8aa5-332257d89719 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.765204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 570/1131] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:45.770252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf09d-6d00-4469-849c-323a5d86aaa7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.770650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf09d-6d00-4469-849c-323a5d86aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.770804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf09d-6d00-4469-849c-323a5d86aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.782271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:45.788310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0ddbf09d-6d00-4469-849c-323a5d86aaa7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:45.789507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0ddbf09d-6d00-4469-849c-323a5d86aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:45.854000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 562/1132] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:45.877702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3625169-ecb3-456e-8aa5-332257d89719 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.974626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3625169-ecb3-456e-8aa5-332257d89719 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:46.007140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a672ce-69a0-4a60-b289-2cea39687d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:46.007911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a672ce-69a0-4a60-b289-2cea39687d7a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:46.008194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a672ce-69a0-4a60-b289-2cea39687d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:46.008470 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a672ce-69a0-4a60-b289-2cea39687d7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:46.009656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a672ce-69a0-4a60-b289-2cea39687d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:46.011083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a672ce-69a0-4a60-b289-2cea39687d7a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:46.013176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 571/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:46.018961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbf09d-6d00-4469-849c-323a5d86aaa7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:46.114586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbf09d-6d00-4469-849c-323a5d86aaa7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:46.147182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581c2c6-a6ef-4774-b2f8-ddcf68e7c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:46.147831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581c2c6-a6ef-4774-b2f8-ddcf68e7c01f None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:46.148114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581c2c6-a6ef-4774-b2f8-ddcf68e7c01f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:46.148391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581c2c6-a6ef-4774-b2f8-ddcf68e7c01f None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:46.149101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581c2c6-a6ef-4774-b2f8-ddcf68e7c01f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:46.150544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581c2c6-a6ef-4774-b2f8-ddcf68e7c01f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:46.155208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:46.175897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 563/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:07:46 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:48.193227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3a504-d040-4c57-aa1b-4e6f6c3a9643 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.193815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3a504-d040-4c57-aa1b-4e6f6c3a9643 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.193986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3a504-d040-4c57-aa1b-4e6f6c3a9643 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.195352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 572/1135] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:48.201152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32c16-845d-4772-a39c-1b5ebbe55be2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.201559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32c16-845d-4772-a39c-1b5ebbe55be2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.201745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32c16-845d-4772-a39c-1b5ebbe55be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.218414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-40b32c16-845d-4772-a39c-1b5ebbe55be2 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:48.219593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-40b32c16-845d-4772-a39c-1b5ebbe55be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:48.284998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 564/1136] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:48.310461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3a504-d040-4c57-aa1b-4e6f6c3a9643 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.313311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:48.409959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3a504-d040-4c57-aa1b-4e6f6c3a9643 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.442981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4d29c-0bc4-4cef-848e-73f2d9bb96b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.443807 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d29c-0bc4-4cef-848e-73f2d9bb96b1 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.444039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d29c-0bc4-4cef-848e-73f2d9bb96b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.444312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d29c-0bc4-4cef-848e-73f2d9bb96b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.445488 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4d29c-0bc4-4cef-848e-73f2d9bb96b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.446919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4d29c-0bc4-4cef-848e-73f2d9bb96b1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.448519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 573/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:48.454263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32c16-845d-4772-a39c-1b5ebbe55be2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.549663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32c16-845d-4772-a39c-1b5ebbe55be2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.566744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:48.583693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23902c9-eb69-4f06-ad5c-f0bfb3dce12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.584348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23902c9-eb69-4f06-ad5c-f0bfb3dce12a None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.584637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23902c9-eb69-4f06-ad5c-f0bfb3dce12a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.584917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23902c9-eb69-4f06-ad5c-f0bfb3dce12a None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.585659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23902c9-eb69-4f06-ad5c-f0bfb3dce12a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.587080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23902c9-eb69-4f06-ad5c-f0bfb3dce12a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.610799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 565/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:50.642083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde047de-1000-493e-9a96-ea6cb2b87e6f None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:50.642592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde047de-1000-493e-9a96-ea6cb2b87e6f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:50.642592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde047de-1000-493e-9a96-ea6cb2b87e6f None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:50.643909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 574/1139] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:50.649054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34db1-1a59-4941-87f5-8849dcb7fd5d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:50.649524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34db1-1a59-4941-87f5-8849dcb7fd5d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:50.649666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34db1-1a59-4941-87f5-8849dcb7fd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:50.667069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-20d34db1-1a59-4941-87f5-8849dcb7fd5d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:50.668251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-20d34db1-1a59-4941-87f5-8849dcb7fd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:50.734449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 566/1140] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:50.757621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde047de-1000-493e-9a96-ea6cb2b87e6f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:50.826265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:50.858090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde047de-1000-493e-9a96-ea6cb2b87e6f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:50.891259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:50.892029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:50.892366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:50.892594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:50.902389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:50.910043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:50.911236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:50.912463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 575/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:07:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:50.917012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d34db1-1a59-4941-87f5-8849dcb7fd5d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:51.013255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d34db1-1a59-4941-87f5-8849dcb7fd5d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:51.015523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:51.046353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:51.047004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:51.047289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:51.047565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:51.048306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:51.048616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:51.050008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:51.057814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 567/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:07:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:51.063871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:51.160464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7f721-bd09-4d93-a768-71e0b180a931 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:51.187812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:51.193820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:51.194662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:51.194947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:51.195222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] PATH_INFO: `/v3/users/537785a512fe4106b3a6b15931853ca2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:51.209241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] RBAC: Authorizing `identity:get_user(user_id=537785a512fe4106b3a6b15931853ca2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:51.210712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:51.212321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 576/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:51 2022] GET /identity/v3/users/537785a512fe4106b3a6b15931853ca2 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:51.218155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:51.315720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bab5b-e645-44f9-a77d-84ed3bc63c4a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:51.348091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:51.348730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:51.349014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:51.349290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:51.382546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:51.415608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:51.416981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:51.511642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 568/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:07:51.517402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:51.611801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738efd0a-5afc-42ae-819f-bb4d85cf821c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:51.644063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163911f-fe77-4616-84e1-e7c3a5d23f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:51.644902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163911f-fe77-4616-84e1-e7c3a5d23f17 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:51.645183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163911f-fe77-4616-84e1-e7c3a5d23f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:51.645482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163911f-fe77-4616-84e1-e7c3a5d23f17 None admin] PATH_INFO: `/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:51.646646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163911f-fe77-4616-84e1-e7c3a5d23f17 None admin] RBAC: Authorizing `identity:get_project(project_id=2f498e3dcf814b5eb1ad01c589ce8d43)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:51.648062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163911f-fe77-4616-84e1-e7c3a5d23f17 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:51.649754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 577/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:51 2022] GET /identity/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:51.656180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:51.718983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:51.752510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34cbff-e2f9-4188-86dc-a5df5bca7ebe None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:51.785409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328d283-33f3-40da-b568-45765e8be81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:51.786068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328d283-33f3-40da-b568-45765e8be81c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:51.786349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328d283-33f3-40da-b568-45765e8be81c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:51.786619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328d283-33f3-40da-b568-45765e8be81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:51.787430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328d283-33f3-40da-b568-45765e8be81c None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=2f498e3dcf814b5eb1ad01c589ce8d43, user.id=537785a512fe4106b3a6b15931853ca2) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:51.787738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328d283-33f3-40da-b568-45765e8be81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:51.789145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328d283-33f3-40da-b568-45765e8be81c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:51.795039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 569/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:51 2022] GET /identity/v3/role_assignments?user.id=537785a512fe4106b3a6b15931853ca2&scope.project.id=2f498e3dcf814b5eb1ad01c589ce8d43&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:53.758994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee120b-3acd-4aaa-b33f-405e3662c471 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:53.759517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee120b-3acd-4aaa-b33f-405e3662c471 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:53.759517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee120b-3acd-4aaa-b33f-405e3662c471 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:53.760890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 578/1147] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:53.766522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e740-c358-4fce-8174-7d22572fe341 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:53.766907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e740-c358-4fce-8174-7d22572fe341 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:53.767085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e740-c358-4fce-8174-7d22572fe341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:53.784002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7458e740-c358-4fce-8174-7d22572fe341 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:53.785176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7458e740-c358-4fce-8174-7d22572fe341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:53.849090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 570/1148] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:53.870929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee120b-3acd-4aaa-b33f-405e3662c471 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:53.926361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:53.969835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee120b-3acd-4aaa-b33f-405e3662c471 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:54.002051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:54.002823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:54.003106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:54.003380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:54.013727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:54.021231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:54.022361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:07:54.023547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 579/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:07:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:54.028512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e740-c358-4fce-8174-7d22572fe341 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:54.086524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:54.126386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e740-c358-4fce-8174-7d22572fe341 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:54.159242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:54.159895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:54.160177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:54.160450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:54.161185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:54.161513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:54.162873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:54.170730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 571/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:54.176631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:54.274200 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba3a5-772f-4efd-980a-fb6edfdd6c5e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:54.289736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:54.307960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:54.308833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:54.309742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:54.310023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] PATH_INFO: `/v3/users/537785a512fe4106b3a6b15931853ca2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:54.311202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] RBAC: Authorizing `identity:get_user(user_id=537785a512fe4106b3a6b15931853ca2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:54.312639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:54.314283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 580/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:54 2022] GET /identity/v3/users/537785a512fe4106b3a6b15931853ca2 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:54.320017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:54.416608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0535-ddd4-40d5-9249-e02a6b99abf0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:54.438916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:54.450373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb191ea-215e-4a4e-a20a-f931929d47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:54.451218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb191ea-215e-4a4e-a20a-f931929d47bf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:54.451505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb191ea-215e-4a4e-a20a-f931929d47bf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:54.451784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb191ea-215e-4a4e-a20a-f931929d47bf None admin] PATH_INFO: `/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:54.452951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb191ea-215e-4a4e-a20a-f931929d47bf None admin] RBAC: Authorizing `identity:get_project(project_id=2f498e3dcf814b5eb1ad01c589ce8d43)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:54.454405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb191ea-215e-4a4e-a20a-f931929d47bf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:54.456096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 572/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:54 2022] GET /identity/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:54.462049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:54.558509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29731-2b09-4a9b-97a5-fa4ca368479e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:54.591185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1dc2-e2de-4c7d-934e-cc828bc79c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:54.592060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1dc2-e2de-4c7d-934e-cc828bc79c88 None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:54.592346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1dc2-e2de-4c7d-934e-cc828bc79c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:54.592623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1dc2-e2de-4c7d-934e-cc828bc79c88 None admin] PATH_INFO: `/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43/users/537785a512fe4106b3a6b15931853ca2/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:54.594633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f1dc2-e2de-4c7d-934e-cc828bc79c88 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f498e3dcf814b5eb1ad01c589ce8d43, user_id=537785a512fe4106b3a6b15931853ca2, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:54.596054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f1dc2-e2de-4c7d-934e-cc828bc79c88 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:54.609004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 581/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:07:54 2022] PUT /identity/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43/users/537785a512fe4106b3a6b15931853ca2/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:56.573918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9faa-738e-44cc-babd-82e022fcfe9d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:56.574436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9faa-738e-44cc-babd-82e022fcfe9d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:56.574526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9faa-738e-44cc-babd-82e022fcfe9d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:56.575831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 573/1154] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:56.580831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c10b-1ea6-406e-b568-0c7d2ab1e915 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:56.581220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c10b-1ea6-406e-b568-0c7d2ab1e915 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:56.581383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c10b-1ea6-406e-b568-0c7d2ab1e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:56.597865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-dc18c10b-1ea6-406e-b568-0c7d2ab1e915 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:56.599025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-dc18c10b-1ea6-406e-b568-0c7d2ab1e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:56.637286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:56.663471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 582/1155] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:56.687312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9faa-738e-44cc-babd-82e022fcfe9d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:56.785483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9faa-738e-44cc-babd-82e022fcfe9d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:56.818444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:56.819210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:56.819493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:56.819768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:56.830047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:07:56.837605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:07:56.838982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:07:56.839941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 574/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:07:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:07:56.844577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c10b-1ea6-406e-b568-0c7d2ab1e915 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:56.939205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c10b-1ea6-406e-b568-0c7d2ab1e915 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:56.972150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:56.972795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:56.973073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:56.973343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:56.974112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:56.974413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:56.975768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:56.984060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 583/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:07:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:56.989696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.037582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:57.085156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379182b-843c-442a-ad4d-06b989a54b29 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.119290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.120144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.120428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.120704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] PATH_INFO: `/v3/users/537785a512fe4106b3a6b15931853ca2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.121912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] RBAC: Authorizing `identity:get_user(user_id=537785a512fe4106b3a6b15931853ca2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.123332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:57.124934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 575/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:07:56 2022] GET /identity/v3/users/537785a512fe4106b3a6b15931853ca2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:57.130498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.164610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:57.226700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f81e83-5c82-4201-919b-9a9efe05dfea None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.258562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.259186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.259466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.259736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.323208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.325140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:57.357367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:57.419611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 584/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 13:07:57.425479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.520930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6a6b-15e1-4fc4-b881-cc1594d355a4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.537717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:57.553678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6bb9b-a04e-4cfc-8e12-cb2786f7dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.554515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6bb9b-a04e-4cfc-8e12-cb2786f7dddb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.554795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6bb9b-a04e-4cfc-8e12-cb2786f7dddb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.555065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6bb9b-a04e-4cfc-8e12-cb2786f7dddb None admin] PATH_INFO: `/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.556208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6bb9b-a04e-4cfc-8e12-cb2786f7dddb None admin] RBAC: Authorizing `identity:get_project(project_id=2f498e3dcf814b5eb1ad01c589ce8d43)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.557644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6bb9b-a04e-4cfc-8e12-cb2786f7dddb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:57.559311 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 576/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:07:57 2022] GET /identity/v3/projects/2f498e3dcf814b5eb1ad01c589ce8d43 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:57.565218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.660553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e328cf8-213c-49e0-83dc-263893130d6f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.693199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80767e1f-064d-42a7-933d-bd6e5fdeb420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.693862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767e1f-064d-42a7-933d-bd6e5fdeb420 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.694144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767e1f-064d-42a7-933d-bd6e5fdeb420 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.694418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767e1f-064d-42a7-933d-bd6e5fdeb420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.695238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80767e1f-064d-42a7-933d-bd6e5fdeb420 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=2f498e3dcf814b5eb1ad01c589ce8d43, user.id=537785a512fe4106b3a6b15931853ca2) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:57.695554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80767e1f-064d-42a7-933d-bd6e5fdeb420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.696958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80767e1f-064d-42a7-933d-bd6e5fdeb420 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:57.700322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:57.703840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 585/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:07:57 2022] GET /identity/v3/role_assignments?user.id=537785a512fe4106b3a6b15931853ca2&scope.project.id=2f498e3dcf814b5eb1ad01c589ce8d43&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:59.703381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75d423-b8ae-405d-bb60-ac4f33a1c785 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.703894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75d423-b8ae-405d-bb60-ac4f33a1c785 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.703894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75d423-b8ae-405d-bb60-ac4f33a1c785 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.705192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 577/1162] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:07:59.710373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3652-aeb8-4be1-b35b-2496b93b2f2c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.710789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3652-aeb8-4be1-b35b-2496b93b2f2c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.710920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3652-aeb8-4be1-b35b-2496b93b2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.727577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-528b3652-aeb8-4be1-b35b-2496b93b2f2c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:59.728778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-528b3652-aeb8-4be1-b35b-2496b93b2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:59.792706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 586/1163] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:07:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:07:59.816008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75d423-b8ae-405d-bb60-ac4f33a1c785 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:59.913334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75d423-b8ae-405d-bb60-ac4f33a1c785 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:59.947109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:59.947724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.948002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.948272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.000576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:00.013559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.014976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.109105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 578/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:07:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:08:00.115285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b3652-aeb8-4be1-b35b-2496b93b2f2c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.210542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b3652-aeb8-4be1-b35b-2496b93b2f2c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.238834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:00.244703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ab099-0f05-492d-91c4-6d71b768f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.245515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab099-0f05-492d-91c4-6d71b768f705 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.245802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab099-0f05-492d-91c4-6d71b768f705 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.246081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab099-0f05-492d-91c4-6d71b768f705 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.252753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ab099-0f05-492d-91c4-6d71b768f705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.254184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ab099-0f05-492d-91c4-6d71b768f705 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5b2ab099-0f05-492d-91c4-6d71b768f705 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:08:00.268496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:08:00.269749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:08:00.270647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 587/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:08:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:08:00.275496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.357632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:00.372546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f32fb-3a76-42b5-b4c9-59418a2c8d79 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.406051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969da5e-eed1-4ef2-b0b7-65f2a4458684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.406710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969da5e-eed1-4ef2-b0b7-65f2a4458684 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.406999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969da5e-eed1-4ef2-b0b7-65f2a4458684 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.407274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969da5e-eed1-4ef2-b0b7-65f2a4458684 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.407989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969da5e-eed1-4ef2-b0b7-65f2a4458684 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:08:00.408299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969da5e-eed1-4ef2-b0b7-65f2a4458684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.409678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969da5e-eed1-4ef2-b0b7-65f2a4458684 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.416607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 579/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Thu Jun 30 13:08:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:02.397139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435ed6e-34ac-4a12-93d7-54391c19fc04 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:02.397641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435ed6e-34ac-4a12-93d7-54391c19fc04 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:02.397743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435ed6e-34ac-4a12-93d7-54391c19fc04 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:02.399100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 588/1167] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:08:02.404078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54aa30-52aa-4bce-988f-6790504abf21 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:02.404484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54aa30-52aa-4bce-988f-6790504abf21 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:02.404634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54aa30-52aa-4bce-988f-6790504abf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:02.420800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2d54aa30-52aa-4bce-988f-6790504abf21 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:02.422000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2d54aa30-52aa-4bce-988f-6790504abf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:02.485940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 580/1168] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:08:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:08:02.508697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435ed6e-34ac-4a12-93d7-54391c19fc04 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:02.607763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435ed6e-34ac-4a12-93d7-54391c19fc04 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:02.640017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff72137-d019-4415-9235-06e8969dfd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:02.640660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72137-d019-4415-9235-06e8969dfd3b None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:02.640943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72137-d019-4415-9235-06e8969dfd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:02.641220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72137-d019-4415-9235-06e8969dfd3b None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:02.641981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff72137-d019-4415-9235-06e8969dfd3b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:02.643345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff72137-d019-4415-9235-06e8969dfd3b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:02.656936 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 589/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Thu Jun 30 13:08:02 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:08:04.664707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a805-8ed4-4615-95f1-5eda2a9e0e19 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:04.665209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a805-8ed4-4615-95f1-5eda2a9e0e19 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:04.665209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a805-8ed4-4615-95f1-5eda2a9e0e19 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:04.666585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 581/1170] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:08:04.671666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6e13-6045-49ce-9271-35305c2d9b48 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:04.672050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6e13-6045-49ce-9271-35305c2d9b48 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:04.672218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6e13-6045-49ce-9271-35305c2d9b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:04.689040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9e4c6e13-6045-49ce-9271-35305c2d9b48 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:04.690251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9e4c6e13-6045-49ce-9271-35305c2d9b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:04.734666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:04.756592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 590/1171] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:08:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:08:04.779790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a805-8ed4-4615-95f1-5eda2a9e0e19 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:04.859491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:04.879106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a805-8ed4-4615-95f1-5eda2a9e0e19 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:04.910883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288c377-ae80-4684-a1aa-b277ac4f8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:04.911718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c377-ae80-4684-a1aa-b277ac4f8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:04.911996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c377-ae80-4684-a1aa-b277ac4f8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:04.912268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c377-ae80-4684-a1aa-b277ac4f8ff4 None admin] PATH_INFO: `/v3/domains/5a71273992654334828ea1ce7e928ab4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:04.922888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288c377-ae80-4684-a1aa-b277ac4f8ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5a71273992654334828ea1ce7e928ab4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:04.924246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288c377-ae80-4684-a1aa-b277ac4f8ff4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:04.925875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 582/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Thu Jun 30 13:08:04 2022] GET /identity/v3/domains/5a71273992654334828ea1ce7e928ab4 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:04.931579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c6e13-6045-49ce-9271-35305c2d9b48 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:05.025746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c6e13-6045-49ce-9271-35305c2d9b48 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:05.058130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe4cfa-1361-49d5-abaa-69f357d48e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:05.058818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4cfa-1361-49d5-abaa-69f357d48e65 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:05.059591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4cfa-1361-49d5-abaa-69f357d48e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:05.059865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4cfa-1361-49d5-abaa-69f357d48e65 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:05.060572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe4cfa-1361-49d5-abaa-69f357d48e65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:05.062018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe4cfa-1361-49d5-abaa-69f357d48e65 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:05.085512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 591/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:08:04 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:08:07.117728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4435b5-a2c6-4524-843d-98cb58bd1b15 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:07.118256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4435b5-a2c6-4524-843d-98cb58bd1b15 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:07.118256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4435b5-a2c6-4524-843d-98cb58bd1b15 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:07.119620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 583/1174] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:08:07.124763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2472e-0105-4e6a-9317-f7de8a874f1e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:07.125182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2472e-0105-4e6a-9317-f7de8a874f1e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:07.125323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2472e-0105-4e6a-9317-f7de8a874f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:07.142452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-38f2472e-0105-4e6a-9317-f7de8a874f1e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:07.143626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-38f2472e-0105-4e6a-9317-f7de8a874f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:07.168545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:07.209191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 592/1175] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:08:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:08:07.234576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4435b5-a2c6-4524-843d-98cb58bd1b15 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:07.332930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4435b5-a2c6-4524-843d-98cb58bd1b15 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:07.366778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9bcc-66aa-4d60-94dd-5506ca62eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:07.367648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9bcc-66aa-4d60-94dd-5506ca62eecc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:07.367979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9bcc-66aa-4d60-94dd-5506ca62eecc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:07.368204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9bcc-66aa-4d60-94dd-5506ca62eecc None admin] PATH_INFO: `/v3/domains/5a71273992654334828ea1ce7e928ab4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:07.369393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f9bcc-66aa-4d60-94dd-5506ca62eecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=5a71273992654334828ea1ce7e928ab4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:07.370875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f9bcc-66aa-4d60-94dd-5506ca62eecc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:07.372988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 584/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Thu Jun 30 13:08:07 2022] GET /identity/v3/domains/5a71273992654334828ea1ce7e928ab4 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:07.378872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2472e-0105-4e6a-9317-f7de8a874f1e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:07.481339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2472e-0105-4e6a-9317-f7de8a874f1e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:07.515066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd7890-f96a-4498-be57-c793682ce0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:07.515737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7890-f96a-4498-be57-c793682ce0d1 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:07.516025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7890-f96a-4498-be57-c793682ce0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:07.516303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7890-f96a-4498-be57-c793682ce0d1 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:07.517021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd7890-f96a-4498-be57-c793682ce0d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:07.518486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd7890-f96a-4498-be57-c793682ce0d1 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:07.539070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 593/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:08:07 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:08:09.595220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c56f-4a7c-4caf-96d5-c17815171732 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:09.595747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c56f-4a7c-4caf-96d5-c17815171732 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:09.595747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c56f-4a7c-4caf-96d5-c17815171732 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:09.597143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 585/1178] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:08:09.602549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3330d-a0aa-429a-9d2d-925386f78c88 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:09.602962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3330d-a0aa-429a-9d2d-925386f78c88 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:09.603053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3330d-a0aa-429a-9d2d-925386f78c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:09.619851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-86e3330d-a0aa-429a-9d2d-925386f78c88 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:09.621030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-86e3330d-a0aa-429a-9d2d-925386f78c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:09.634297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:09.687234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 594/1179] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:08:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:08:09.710093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699c56f-4a7c-4caf-96d5-c17815171732 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:09.722683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:09.809663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699c56f-4a7c-4caf-96d5-c17815171732 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:09.841825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:09.842584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:09.842862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:09.843131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:09.853222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:08:09.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:08:09.862378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:08:09.863628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 586/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:08:09.868123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3330d-a0aa-429a-9d2d-925386f78c88 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:09.964499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3330d-a0aa-429a-9d2d-925386f78c88 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:09.997646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:09.998294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:09.998578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:09.998855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:09.999628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:08:09.999934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:10.001293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:10.009164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 595/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:10.015114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:10.078708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:10.111819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d277d-4019-4548-934a-798c80c892c8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:10.144257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:10.145101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:10.145380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:10.145679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] PATH_INFO: `/v3/users/719586b58efe4cdc87a84d348c74fdff` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:10.158836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] RBAC: Authorizing `identity:get_user(user_id=719586b58efe4cdc87a84d348c74fdff)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:10.160257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:10.161901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 587/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:08:10 2022] GET /identity/v3/users/719586b58efe4cdc87a84d348c74fdff => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:08:10.167510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:10.180116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:10.264094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef98bd3-ee94-44b0-b8bd-ba6d2c718d76 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:10.296172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:10.296800 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:10.297077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:10.297345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:10.362494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:10.363899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:10.375206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:10.459779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 596/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:08:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:08:10.465855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:10.561747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937ee44-a945-4c5d-81f4-10025eafd52f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:10.586660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:10.595630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e2ecf-e9f9-4f8e-b98c-c7fac4da8b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:10.596472 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2ecf-e9f9-4f8e-b98c-c7fac4da8b9c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:10.596755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2ecf-e9f9-4f8e-b98c-c7fac4da8b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:10.597028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2ecf-e9f9-4f8e-b98c-c7fac4da8b9c None admin] PATH_INFO: `/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:10.598237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e2ecf-e9f9-4f8e-b98c-c7fac4da8b9c None admin] RBAC: Authorizing `identity:get_project(project_id=a4c5d585a9364bf096e2cb387adb8a7d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:10.599654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e2ecf-e9f9-4f8e-b98c-c7fac4da8b9c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:10.601309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 588/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:08:10 2022] GET /identity/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:10.607298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:10.702471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90c6ac-6552-4132-b2c6-005b801a0a2b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:10.712579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:10.735577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf202-95d1-4bc0-a4f0-aed987ce7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:10.736213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf202-95d1-4bc0-a4f0-aed987ce7c8c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:10.736499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf202-95d1-4bc0-a4f0-aed987ce7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:10.736777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf202-95d1-4bc0-a4f0-aed987ce7c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:10.737635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf202-95d1-4bc0-a4f0-aed987ce7c8c None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a4c5d585a9364bf096e2cb387adb8a7d, user.id=719586b58efe4cdc87a84d348c74fdff) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:08:10.737952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf202-95d1-4bc0-a4f0-aed987ce7c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:10.739366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf202-95d1-4bc0-a4f0-aed987ce7c8c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:10.744623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 597/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:08:10 2022] GET /identity/v3/role_assignments?user.id=719586b58efe4cdc87a84d348c74fdff&scope.project.id=a4c5d585a9364bf096e2cb387adb8a7d&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:12.728831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822e98-7c0c-41a9-b390-1fac9237aab3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:12.729347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822e98-7c0c-41a9-b390-1fac9237aab3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:12.729347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822e98-7c0c-41a9-b390-1fac9237aab3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:12.730754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 589/1186] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:08:12.735868 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fd2e-e074-46ac-8f6f-d0fdc0c36952 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:12.736250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fd2e-e074-46ac-8f6f-d0fdc0c36952 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:12.736426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fd2e-e074-46ac-8f6f-d0fdc0c36952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:12.753168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5865fd2e-e074-46ac-8f6f-d0fdc0c36952 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:12.754365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5865fd2e-e074-46ac-8f6f-d0fdc0c36952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:12.818377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 598/1187] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:08:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:08:12.841201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822e98-7c0c-41a9-b390-1fac9237aab3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:12.938926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822e98-7c0c-41a9-b390-1fac9237aab3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:12.971793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:12.972562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:12.972844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:12.973127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:12.983225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:08:12.990810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:08:12.991907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:08:12.992928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 590/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:08:12.998698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fd2e-e074-46ac-8f6f-d0fdc0c36952 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:13.094101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fd2e-e074-46ac-8f6f-d0fdc0c36952 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:13.096347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:13.128606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:13.129257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:13.129566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:13.129843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:13.130577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:08:13.130880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:13.132240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:13.140099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 599/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:13.145905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:13.199737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:13.243219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3b952-af04-4451-95fe-b06a85026c59 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:13.275254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:13.276098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:13.276377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:13.276647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] PATH_INFO: `/v3/users/719586b58efe4cdc87a84d348c74fdff` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:13.277936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] RBAC: Authorizing `identity:get_user(user_id=719586b58efe4cdc87a84d348c74fdff)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:13.279356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:13.280940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 591/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:08:13 2022] GET /identity/v3/users/719586b58efe4cdc87a84d348c74fdff => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:13.286912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:13.383797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f6242-bff4-4a93-8d6a-85f23703ebb2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:13.415704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a364831-d582-406c-995e-c254b80213c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:13.416549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a364831-d582-406c-995e-c254b80213c7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:13.416831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a364831-d582-406c-995e-c254b80213c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:13.417103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a364831-d582-406c-995e-c254b80213c7 None admin] PATH_INFO: `/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:13.418861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a364831-d582-406c-995e-c254b80213c7 None admin] RBAC: Authorizing `identity:get_project(project_id=a4c5d585a9364bf096e2cb387adb8a7d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:13.420269 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a364831-d582-406c-995e-c254b80213c7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:13.421974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 600/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:08:13 2022] GET /identity/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:13.427750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:13.524155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098019-a50f-41f6-9c89-fb8904b51b7f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:13.546069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:13.557833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a023cb-d7b5-43d2-a814-ee75da6f9f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:13.558700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a023cb-d7b5-43d2-a814-ee75da6f9f8b None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:13.558980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a023cb-d7b5-43d2-a814-ee75da6f9f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:13.559251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a023cb-d7b5-43d2-a814-ee75da6f9f8b None admin] PATH_INFO: `/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d/users/719586b58efe4cdc87a84d348c74fdff/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:13.561201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a023cb-d7b5-43d2-a814-ee75da6f9f8b None admin] RBAC: Authorizing `identity:create_grant(project_id=a4c5d585a9364bf096e2cb387adb8a7d, user_id=719586b58efe4cdc87a84d348c74fdff, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:13.562642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a023cb-d7b5-43d2-a814-ee75da6f9f8b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:13.574322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 592/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:08:13 2022] PUT /identity/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d/users/719586b58efe4cdc87a84d348c74fdff/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:08:15.565529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba57fb-9c14-435d-9b14-34bd00ab8185 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:15.566105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba57fb-9c14-435d-9b14-34bd00ab8185 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:15.566105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba57fb-9c14-435d-9b14-34bd00ab8185 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:15.567429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 601/1193] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:08:15.572610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef15b-6d0d-4508-beca-5e89f06bb625 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:15.573039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef15b-6d0d-4508-beca-5e89f06bb625 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:15.573251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef15b-6d0d-4508-beca-5e89f06bb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:15.591008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-303ef15b-6d0d-4508-beca-5e89f06bb625 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:15.592166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-303ef15b-6d0d-4508-beca-5e89f06bb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:15.656427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 593/1194] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:08:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:08:15.679479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba57fb-9c14-435d-9b14-34bd00ab8185 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:15.714926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:15.780289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba57fb-9c14-435d-9b14-34bd00ab8185 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:15.812529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:15.813307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:15.813616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:15.813890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:15.824775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:08:15.832412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:08:15.833655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:08:15.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 602/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:08:15.840082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef15b-6d0d-4508-beca-5e89f06bb625 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:15.935004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef15b-6d0d-4508-beca-5e89f06bb625 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:15.947559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:15.970190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:15.970841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:15.971123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:15.971397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:15.972131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:08:15.972437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:15.973818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:15.981620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 594/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:15.987341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:16.078079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:16.084926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57376f-564d-4a8f-babf-0a28a01da077 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:16.118499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:16.119353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:16.119635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:16.119911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] PATH_INFO: `/v3/users/719586b58efe4cdc87a84d348c74fdff` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:16.121704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] RBAC: Authorizing `identity:get_user(user_id=719586b58efe4cdc87a84d348c74fdff)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:16.123141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:16.124757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 603/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Thu Jun 30 13:08:15 2022] GET /identity/v3/users/719586b58efe4cdc87a84d348c74fdff => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:16.130347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:16.227635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856321-4e91-42d1-9b86-5e7e5ac5c587 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:16.260702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:16.261337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:16.261648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:16.261923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:16.302201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:16.326598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:16.328023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:16.422908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 595/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:08:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:08:16.428642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:16.523017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff38e-0df9-413c-85e1-489796e4a95f None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:16.555970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15fc5b-c40a-4e17-a484-f5699c581f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:16.556809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15fc5b-c40a-4e17-a484-f5699c581f84 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:16.557100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15fc5b-c40a-4e17-a484-f5699c581f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:16.557375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15fc5b-c40a-4e17-a484-f5699c581f84 None admin] PATH_INFO: `/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:16.558598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15fc5b-c40a-4e17-a484-f5699c581f84 None admin] RBAC: Authorizing `identity:get_project(project_id=a4c5d585a9364bf096e2cb387adb8a7d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:16.560015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15fc5b-c40a-4e17-a484-f5699c581f84 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:16.561703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 604/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Thu Jun 30 13:08:16 2022] GET /identity/v3/projects/a4c5d585a9364bf096e2cb387adb8a7d => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:08:16.567650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:16.638900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:16.663690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266122f-2bc8-4445-8e1c-16bfea420d8f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:16.696683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df50d82-1f52-40d0-ae10-110791fc00da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:16.697316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50d82-1f52-40d0-ae10-110791fc00da None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:16.697625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50d82-1f52-40d0-ae10-110791fc00da None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:16.697900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50d82-1f52-40d0-ae10-110791fc00da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:16.698713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50d82-1f52-40d0-ae10-110791fc00da None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a4c5d585a9364bf096e2cb387adb8a7d, user.id=719586b58efe4cdc87a84d348c74fdff) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:08:16.699023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50d82-1f52-40d0-ae10-110791fc00da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:16.700451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50d82-1f52-40d0-ae10-110791fc00da None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:16.706037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 596/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:08:16 2022] GET /identity/v3/role_assignments?user.id=719586b58efe4cdc87a84d348c74fdff&scope.project.id=a4c5d585a9364bf096e2cb387adb8a7d&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:26.551956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=85 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:26.703555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=31 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:11.784180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ded07-257f-4c40-8411-fba7ad47a3ff None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:11.784821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ded07-257f-4c40-8411-fba7ad47a3ff None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:11.784821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ded07-257f-4c40-8411-fba7ad47a3ff None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:11.788130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 605/1201] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:11.793441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a070-c1e6-48d7-a1c4-39ec10b8c873 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:11.793960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a070-c1e6-48d7-a1c4-39ec10b8c873 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:11.794073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a070-c1e6-48d7-a1c4-39ec10b8c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:11.812653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1a94a070-c1e6-48d7-a1c4-39ec10b8c873 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:11.814048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1a94a070-c1e6-48d7-a1c4-39ec10b8c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:11.907430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 597/1202] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:11.936542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ded07-257f-4c40-8411-fba7ad47a3ff None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:12.068093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ded07-257f-4c40-8411-fba7ad47a3ff None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:12.113502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:12.114707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:12.114993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:12.115276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:12.126811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:12.128316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:12.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:12.152147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:12.153169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:12.153169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:12.153169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:12.153169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:12.153169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 606/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:12.158602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a070-c1e6-48d7-a1c4-39ec10b8c873 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:12.288494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a070-c1e6-48d7-a1c4-39ec10b8c873 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:12.324947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:12.343984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7943d8b-4abe-4480-8815-d04c29950f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:12.344981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7943d8b-4abe-4480-8815-d04c29950f18 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:12.345425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7943d8b-4abe-4480-8815-d04c29950f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:12.345949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7943d8b-4abe-4480-8815-d04c29950f18 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:12.346659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7943d8b-4abe-4480-8815-d04c29950f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:12.346970 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7943d8b-4abe-4480-8815-d04c29950f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:12.348811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7943d8b-4abe-4480-8815-d04c29950f18 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:12.362537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 598/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:12.368898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:12.440378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:12.503062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f965a1-83c5-46e9-8aa4-4695f5fa1d04 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:12.542824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ad81c-516e-4195-939b-49f7ff145bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:12.543505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad81c-516e-4195-939b-49f7ff145bc2 None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:12.543788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad81c-516e-4195-939b-49f7ff145bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:12.544075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad81c-516e-4195-939b-49f7ff145bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:12.544772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ad81c-516e-4195-939b-49f7ff145bc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:12.546286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ad81c-516e-4195-939b-49f7ff145bc2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:12.573401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 607/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Thu Jun 30 13:09:12 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:09:14.869744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef169-c56d-4c1b-bcb4-53b3f938a045 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:14.870824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef169-c56d-4c1b-bcb4-53b3f938a045 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:14.870937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef169-c56d-4c1b-bcb4-53b3f938a045 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:14.872710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 599/1206] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:14.878508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30036263-1e14-4ab0-93b7-02c5b423bfac None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:14.879054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30036263-1e14-4ab0-93b7-02c5b423bfac None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:14.879054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30036263-1e14-4ab0-93b7-02c5b423bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:14.898258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-30036263-1e14-4ab0-93b7-02c5b423bfac None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:14.899440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-30036263-1e14-4ab0-93b7-02c5b423bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:14.972812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 608/1207] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:14.999930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef169-c56d-4c1b-bcb4-53b3f938a045 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:15.122872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef169-c56d-4c1b-bcb4-53b3f938a045 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:15.167495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:15.168382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:15.168670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:15.168942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:15.184943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:09:15.192956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:15.194110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:15.194965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 600/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:09:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:15.201662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30036263-1e14-4ab0-93b7-02c5b423bfac None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:15.244460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:15.320909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30036263-1e14-4ab0-93b7-02c5b423bfac None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:15.367843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:15.368797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:15.369139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:15.369411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:15.370866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:15.371228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:15.372694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:15.383542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 609/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:09:15.387600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:15.441789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:15.505295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5dfa0-1f26-4a6a-b000-6dfc44eba15a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:15.546266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:15.547060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:15.547346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:15.547625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:15.559538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:15.561147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:15.581428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:15.582649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:15.583552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:15.583552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:15.583552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:15.583552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:15.583552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 601/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:15.586559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:15.702457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:15.705946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc7689-020b-4550-9270-925c6fa70653 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:15.751511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:15.751511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:15.751511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:15.751511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:15.751942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:15.752021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:15.753347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:15.771520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 610/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:15.772736 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:15.888285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c95f9-324e-410d-8199-4acda1c27022 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:15.890164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:15.928810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:15.929655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:15.930071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:15.930424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:15.938853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:15.940365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:09:15.958492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:15.959623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:15.966300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 602/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:15.967038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:16.101101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58063d-67dd-48f4-9091-cf7fadb33cdf None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:16.142589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:16.143960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:16.143960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:16.143960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:16.144907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:16.145105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:16.146534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:16.167818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 611/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Thu Jun 30 13:09:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:16.173590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:16.308507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f97021-2a39-4647-ad07-34a79fbb7289 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:16.359898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:16.360912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:16.361481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:16.362031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:16.406913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:16.467760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:16.469680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:16.588219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 603/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:09:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:09:16.594409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:16.616234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:16.712516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90a15-44b6-4bc9-9700-0bf1a027bb30 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:16.758144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:16.759017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:16.759324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:16.759634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:16.772316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:16.773814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:16.793927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:16.795552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:16.797305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:16.797305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:16.797305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:16.797305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:16.797305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 612/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:16.802426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:16.872625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:16.920931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba403d-3b65-4167-af3e-b8b5abd9c924 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:16.959304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:16.960006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:16.960299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:16.960569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:16.961294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:16.962592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:16.963119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:16.976388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 604/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:16.983627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:17.070983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:17.107062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa219-64a6-4015-ae3a-7629d97153f9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:17.149950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:17.150747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:17.151035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:17.151355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:17.160686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:17.162376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:09:17.178230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:17.179448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:17.186043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 613/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:09:17.186685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:17.299468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845029f-2de7-4307-abc2-19096de80367 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:17.324622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:17.339673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023658e1-c9b9-4e9a-8f06-f5b15b739a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:17.340489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023658e1-c9b9-4e9a-8f06-f5b15b739a6f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:17.340873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023658e1-c9b9-4e9a-8f06-f5b15b739a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:17.341251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023658e1-c9b9-4e9a-8f06-f5b15b739a6f None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:17.342205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023658e1-c9b9-4e9a-8f06-f5b15b739a6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:17.342614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023658e1-c9b9-4e9a-8f06-f5b15b739a6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:17.344237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023658e1-c9b9-4e9a-8f06-f5b15b739a6f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:17.359152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 605/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:17.365237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:17.477790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bb2ac-c9a8-498d-9532-82c1fb61a570 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:17.515246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:17.522175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd0a3f-ee5a-45c8-90bd-7b8a9b1adb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:17.522915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd0a3f-ee5a-45c8-90bd-7b8a9b1adb55 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:17.523203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd0a3f-ee5a-45c8-90bd-7b8a9b1adb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:17.523471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd0a3f-ee5a-45c8-90bd-7b8a9b1adb55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:17.524312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd0a3f-ee5a-45c8-90bd-7b8a9b1adb55 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=eaaa0a5f15ee4338a750795e4abbb64d) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:17.524626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd0a3f-ee5a-45c8-90bd-7b8a9b1adb55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:17.526099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd0a3f-ee5a-45c8-90bd-7b8a9b1adb55 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:17.537505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 614/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:09:17 2022] GET /identity/v3/role_assignments?user.id=eaaa0a5f15ee4338a750795e4abbb64d&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:09:19.606878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410396c-5726-4f30-9e24-5da178745798 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:19.607393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410396c-5726-4f30-9e24-5da178745798 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:19.607493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410396c-5726-4f30-9e24-5da178745798 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:19.609012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 606/1220] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:09:19.614370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d04c-f44c-4ba9-8c86-76b3f2c178ff None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:19.614795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d04c-f44c-4ba9-8c86-76b3f2c178ff None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:19.614930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d04c-f44c-4ba9-8c86-76b3f2c178ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:19.633082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-08a5d04c-f44c-4ba9-8c86-76b3f2c178ff None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:19.634305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-08a5d04c-f44c-4ba9-8c86-76b3f2c178ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:19.707513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 615/1221] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:19.730150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410396c-5726-4f30-9e24-5da178745798 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:19.836689 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410396c-5726-4f30-9e24-5da178745798 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:19.874677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:19.875423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:19.875707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:19.875977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:19.885909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:09:19.893611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:19.894755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:09:19.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:19.897637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 607/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:09:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:19.900819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5d04c-f44c-4ba9-8c86-76b3f2c178ff None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:20.002678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5d04c-f44c-4ba9-8c86-76b3f2c178ff None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:20.025520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:20.036436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:20.037095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:20.037381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:20.037710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:20.038433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] RBAC: Adding query filter params (name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:20.038730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:20.040093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:20.048779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 616/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:09:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:20.055313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:20.099290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:20.161499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37faa-eab4-447c-aaaf-5891964a0565 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:20.196558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:20.197306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:20.197665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:20.197907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:20.208451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:20.209921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:20.227450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:20.228566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:20.230181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:20.230181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:20.230181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:20.230181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:20.230181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 608/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:20.235107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:20.335777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb52e-6d18-4ea7-a56e-b0821ac76448 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:20.374643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:20.375304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:20.375587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:20.375863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:20.376581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:20.376886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:20.378297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:20.390992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 617/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:20.396950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:20.512653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:20.519843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ad65-0b3c-45a6-9852-02dbd3c2eb4a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:20.554603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:20.555527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:20.555826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:20.556134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:20.564862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:20.566629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:09:20.583737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:20.584791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:20.585857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 609/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:20.592413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:20.649440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:20.705627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a1196-f674-4d06-a04c-eccf23dc40c6 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:20.745078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:20.746141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:20.746530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:20.746935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:20.747859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:20.748165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:20.749599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:20.771648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 618/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Thu Jun 30 13:09:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:09:20.777203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:20.894627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e5c32-99fa-4eb4-b634-a2bcf1969dbf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:20.928830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:20.929651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:20.929932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:20.930205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:20.941378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:20.942854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:20.960419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:20.961443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:20.962418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:20.962418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:20.962418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:20.962418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:20.962418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 610/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:20.967799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:21.075168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f3295-e213-4170-9e2d-a88e3db3352b None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:21.077491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:21.116002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:21.116716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:21.117011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:21.117277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:21.118037 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:21.118343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:21.119708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:21.133367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 619/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:21.140298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:21.150952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:21.249974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d9a81-f147-44f8-a5eb-d1d32811a914 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:21.284344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:21.285132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:21.285410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:21.285708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:21.293231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:21.294696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:09:21.309549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:21.310667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:21.312210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 611/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:21.317076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:21.426102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d87c-abba-4847-9bf8-a07ac184d202 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:21.464650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb0e4d-3fea-4a91-b26c-001b144014be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:21.465410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0e4d-3fea-4a91-b26c-001b144014be None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:21.465769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0e4d-3fea-4a91-b26c-001b144014be None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:21.466048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0e4d-3fea-4a91-b26c-001b144014be None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:21.466991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb0e4d-3fea-4a91-b26c-001b144014be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:21.467309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb0e4d-3fea-4a91-b26c-001b144014be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:21.469011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb0e4d-3fea-4a91-b26c-001b144014be None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:21.483531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 620/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:09:21.489520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:21.561711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:21.601445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4bbfc-530b-4f90-9f4a-0536e40df479 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:21.641725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287ce4f-7ff7-4cdb-8c9c-b187d9383f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:21.642578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287ce4f-7ff7-4cdb-8c9c-b187d9383f7d None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:21.642933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287ce4f-7ff7-4cdb-8c9c-b187d9383f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:21.643239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287ce4f-7ff7-4cdb-8c9c-b187d9383f7d None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/eaaa0a5f15ee4338a750795e4abbb64d/roles/459550c1127b4295b6ceedf2ebd8003c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:21.660713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287ce4f-7ff7-4cdb-8c9c-b187d9383f7d None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=eaaa0a5f15ee4338a750795e4abbb64d, role_id=459550c1127b4295b6ceedf2ebd8003c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:21.662349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287ce4f-7ff7-4cdb-8c9c-b187d9383f7d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:21.675790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 612/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:09:21 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/eaaa0a5f15ee4338a750795e4abbb64d/roles/459550c1127b4295b6ceedf2ebd8003c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:09:23.797804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6a48f-34b3-4d7e-8e13-dab4b0e63403 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:23.798355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6a48f-34b3-4d7e-8e13-dab4b0e63403 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:23.798355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6a48f-34b3-4d7e-8e13-dab4b0e63403 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:23.799866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 621/1233] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:09:23.805491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d75b-af98-44c6-98c5-025ebd05a526 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:23.806039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d75b-af98-44c6-98c5-025ebd05a526 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:23.806039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d75b-af98-44c6-98c5-025ebd05a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:23.824372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9ce8d75b-af98-44c6-98c5-025ebd05a526 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:23.825828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ce8d75b-af98-44c6-98c5-025ebd05a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:23.896746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 613/1234] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:23.922689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6a48f-34b3-4d7e-8e13-dab4b0e63403 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:23.950058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:24.036364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6a48f-34b3-4d7e-8e13-dab4b0e63403 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:24.077017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:24.078017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:24.078403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:24.078664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:24.090721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:09:24.099315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:24.100622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:24.101724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 622/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Thu Jun 30 13:09:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:24.108172 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8d75b-af98-44c6-98c5-025ebd05a526 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:24.170276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:24.232342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8d75b-af98-44c6-98c5-025ebd05a526 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:24.267114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:24.267817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:24.268159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:24.268479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:24.269247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:24.269580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:24.271001 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:24.280926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 614/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Thu Jun 30 13:09:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:24.287317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:24.377659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:24.396378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3de1-7418-40f1-aa69-874b7483de39 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:24.432740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:24.433599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:24.433976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:24.434258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:24.446327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:24.448601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:24.469925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:24.470922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:24.472460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:24.472460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:24.472460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:24.472460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:24.472460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 623/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:24.477515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:24.592927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949723c-b86e-4af7-81b5-d1913da80a4f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:24.602368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:24.631042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:24.631629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:24.631911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:24.632185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:24.632900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:24.633299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:24.634870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:24.650262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 615/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:24.656194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:24.766189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d78dc-8d2e-4f5f-be53-21749de31752 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:24.806049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:24.806916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:24.807202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:24.807983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:24.811005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:24.816905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:24.818526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:09:24.834795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:24.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:24.836768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 624/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:24.842066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:24.954216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4e88d-01dd-427b-9a5a-8161ca48a984 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:24.991216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:24.991936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:24.992232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:24.992559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:24.993576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:24.993936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:24.996136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:25.016818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 616/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Thu Jun 30 13:09:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:09:25.022466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:25.134177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2acb13-f51e-4a26-844d-87c1978cf5d0 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:25.173310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:25.175098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:25.175098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:25.175098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:25.238200 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:25.246387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:25.247858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:25.355684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 625/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:09:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:09:25.361370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:25.393769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:25.477262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194fda0-e9ce-4c06-863e-78c6fc0af30f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:25.515713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:25.516484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:25.516790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:25.517087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:25.527897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:25.529338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:25.551317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:25.552262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:25.553167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:25.553167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:25.553167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:25.553167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:25.553167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 617/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:25.558994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:25.663327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:25.670506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac674-0ad4-48c5-b411-3b18d53ea8f5 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:25.707744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:25.708405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:25.708734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:25.709012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:25.709778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:25.710100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:25.711475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:25.723664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 626/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:25.730318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:25.811005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:25.836617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5403ec-6e4d-41fc-a1cb-1d6b9d088c4e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:25.875530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:25.876316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:25.876601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:25.876886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:25.883965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:25.885413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:09:25.902597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:25.903927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:25.905178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 618/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:25.909892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:26.020794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa2ec-7fc7-4c00-8bb6-a8bd50479a48 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:26.059030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5c2dc-04d1-48b4-b978-066c00c5be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:26.059684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c2dc-04d1-48b4-b978-066c00c5be35 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:26.059968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c2dc-04d1-48b4-b978-066c00c5be35 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:26.060239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c2dc-04d1-48b4-b978-066c00c5be35 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:26.061070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5c2dc-04d1-48b4-b978-066c00c5be35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:26.061336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5c2dc-04d1-48b4-b978-066c00c5be35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:26.062839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5c2dc-04d1-48b4-b978-066c00c5be35 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:26.082174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 627/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:26.083620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:26.199308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95651-15a5-445d-a603-2c9972587b6a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:26.239400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a6bb-005e-4e4b-84b1-b9d8fb21c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:26.240025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a6bb-005e-4e4b-84b1-b9d8fb21c811 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:26.240307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a6bb-005e-4e4b-84b1-b9d8fb21c811 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:26.240576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a6bb-005e-4e4b-84b1-b9d8fb21c811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:26.241397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a6bb-005e-4e4b-84b1-b9d8fb21c811 None admin] RBAC: Adding query filter params (role.id=459550c1127b4295b6ceedf2ebd8003c, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=eaaa0a5f15ee4338a750795e4abbb64d) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:26.241737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a6bb-005e-4e4b-84b1-b9d8fb21c811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:26.243895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a6bb-005e-4e4b-84b1-b9d8fb21c811 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:26.251382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 619/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:09:26 2022] GET /identity/v3/role_assignments?user.id=eaaa0a5f15ee4338a750795e4abbb64d&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=459550c1127b4295b6ceedf2ebd8003c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:28.345207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111bade-2b40-4c1b-a8bb-bd62645741b6 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:28.345764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111bade-2b40-4c1b-a8bb-bd62645741b6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:28.345844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111bade-2b40-4c1b-a8bb-bd62645741b6 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:28.347166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 628/1247] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:28.352769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61388-5b5c-45f8-91c7-facf8d5b91c6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:28.353331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61388-5b5c-45f8-91c7-facf8d5b91c6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:28.353331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61388-5b5c-45f8-91c7-facf8d5b91c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:28.358634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:28.374375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-85f61388-5b5c-45f8-91c7-facf8d5b91c6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:28.376097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85f61388-5b5c-45f8-91c7-facf8d5b91c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:28.451523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 620/1248] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:28.476968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111bade-2b40-4c1b-a8bb-bd62645741b6 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:28.501551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:28.594569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111bade-2b40-4c1b-a8bb-bd62645741b6 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:28.640464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:28.641740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:28.642185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:28.642780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:28.655582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:09:28.669795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:28.670934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:09:28.671940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:28.678889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 629/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:09:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:28.680329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f61388-5b5c-45f8-91c7-facf8d5b91c6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:28.805629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f61388-5b5c-45f8-91c7-facf8d5b91c6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:28.840915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:28.846930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:28.847619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:28.847898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:28.848175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:28.848928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:28.849232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:28.850930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:28.861701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 621/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:28.867693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:28.958414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:28.984015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ad36a-056f-405f-829c-d034262a41cf None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:29.024270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:29.025065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:29.025349 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:29.025753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:29.037697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:29.039272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:29.061021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:29.062179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:29.063081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:29.063081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:29.063081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:29.063081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:29.063081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 630/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:29.068851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:29.190546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a7d4b-41c5-4b03-acb2-f85ad24ae6e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:29.226372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:29.226957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:29.227243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:29.227523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:29.228242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:29.228553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:29.230573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:29.243447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 622/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:29.250043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:29.358638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103fc95-429a-4114-8864-bed3ece102d9 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:29.386410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:29.395441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:29.396245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:29.396531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:29.396809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:29.406585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:29.408045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:09:29.422906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:29.424078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:29.425058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 631/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:29.430444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:29.492486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:29.546766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54608-f2dc-48da-883f-ab9177848228 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:29.583834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:29.584506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:29.584822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:29.585103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:29.585973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:29.586288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:29.587715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:29.606330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 623/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Thu Jun 30 13:09:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:29.613292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:29.730511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99fea-4589-4491-93ae-37ac02c18a7e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:29.772143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:29.772820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:29.773149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:29.773424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:29.833788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:29.848158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:29.849907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:29.960159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 632/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:09:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:09:29.967141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:30.071642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ff867-b4da-4177-905d-beaf6e5c8db5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:30.085946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:30.110355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:30.111116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:30.111394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:30.111678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:30.124169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:30.125838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:30.145642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:30.147417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:30.148687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:30.148687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:30.148687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:30.148687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:30.148687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 624/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 13:09:30.152800 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:30.255757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:30.269693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb764a-f7e4-4229-928b-13ff935aa892 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:30.304945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:30.305635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:30.305931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:30.306186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:30.306894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:30.307197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:30.309712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:30.322327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 633/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:09:30.328484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:30.441418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cfc62-7540-4a33-8d79-f196aaeb1601 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:30.477908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:30.478712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:30.478995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:30.479829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:30.487124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:30.488869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:09:30.504275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:30.505383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:30.506389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 625/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:30.511456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:30.625031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf776d-6577-4dc5-8b9f-a2bb83168dd2 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:30.665279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb8c20-f6bb-4f4b-9bd1-13b3d576f049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:30.665972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb8c20-f6bb-4f4b-9bd1-13b3d576f049 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:30.666261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb8c20-f6bb-4f4b-9bd1-13b3d576f049 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:30.666539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb8c20-f6bb-4f4b-9bd1-13b3d576f049 None admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:30.668012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb8c20-f6bb-4f4b-9bd1-13b3d576f049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:30.668324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb8c20-f6bb-4f4b-9bd1-13b3d576f049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:30.669775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb8c20-f6bb-4f4b-9bd1-13b3d576f049 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:30.682720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 634/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:09:30.689026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:30.718228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:30.805681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16af13-87f8-4f7c-92f5-f24028f3b220 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:30.841223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b3f9d-d001-4ebc-a16e-9d4b83809419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:30.841941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b3f9d-d001-4ebc-a16e-9d4b83809419 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:30.842223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b3f9d-d001-4ebc-a16e-9d4b83809419 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:30.842499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b3f9d-d001-4ebc-a16e-9d4b83809419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:30.843328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b3f9d-d001-4ebc-a16e-9d4b83809419 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=eaaa0a5f15ee4338a750795e4abbb64d) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:30.843641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b3f9d-d001-4ebc-a16e-9d4b83809419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:30.845268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b3f9d-d001-4ebc-a16e-9d4b83809419 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:30.851218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 626/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:09:30 2022] GET /identity/v3/role_assignments?user.id=eaaa0a5f15ee4338a750795e4abbb64d&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:32.907419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e431bf-2099-4c3b-bbd0-04f55769f76e None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:32.907968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e431bf-2099-4c3b-bbd0-04f55769f76e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:32.907968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e431bf-2099-4c3b-bbd0-04f55769f76e None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:32.909347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 635/1261] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:32.914669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca9a19-35f2-4566-a19b-ebad0c8a8c38 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:32.915038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca9a19-35f2-4566-a19b-ebad0c8a8c38 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:32.915220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca9a19-35f2-4566-a19b-ebad0c8a8c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:32.931415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-17ca9a19-35f2-4566-a19b-ebad0c8a8c38 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:32.933168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-17ca9a19-35f2-4566-a19b-ebad0c8a8c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:32.997410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 627/1262] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:33.019594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e431bf-2099-4c3b-bbd0-04f55769f76e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:33.030120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:33.122275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e431bf-2099-4c3b-bbd0-04f55769f76e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:33.162705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:33.163416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:33.163751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:33.164116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:33.174982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:09:33.183681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:33.184687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:33.185767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 636/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:33.191009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca9a19-35f2-4566-a19b-ebad0c8a8c38 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:33.209517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:33.287071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca9a19-35f2-4566-a19b-ebad0c8a8c38 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:33.320250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:33.320900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:33.321185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:33.321489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:33.322225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:33.322530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:33.323915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:33.331673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 628/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:09:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:33.337194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:33.402090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:33.435073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc6bde-b843-47d7-b0f5-c00cc082cd72 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:33.466722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:33.467502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:33.467785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:33.468062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:33.478122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:33.480115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:33.497019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:33.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:33.499293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:33.499293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:33.499293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:33.499293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:33.499293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 637/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:33.503892 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:33.582043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:33.600749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5d78f-39a6-4a25-927a-ebf95a917ae6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:33.633723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:33.634362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:33.634644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:33.634922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:33.635657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:33.635963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:33.637312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:33.648638 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 629/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:33.654599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:33.752157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f4c65-6e81-401d-9d16-a93d113fbfc4 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:33.770826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:33.785270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:33.786081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:33.786365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:33.786639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:33.794452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:33.795870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:09:33.809675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:33.810846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:33.812167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 638/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:33.816338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:33.911817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeab4e-ccfb-469c-accf-5f8a06d8d5b7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:33.944240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:33.944884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:33.945165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:33.945439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:33.946286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:33.946590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:33.948034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:33.956348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:33.965249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 630/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Thu Jun 30 13:09:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:33.970583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:34.068163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009912-3671-4aae-9e46-496bad16803c None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:34.101664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:34.102515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:34.102862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:34.103140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:34.114269 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:34.115863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:34.134535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:34.136313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:34.137221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:34.137221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:34.137221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:34.137221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:34.137221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 639/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:34.142022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:34.238063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb978151-5b35-4855-bc10-196617b55836 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:34.270357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:34.270989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:34.271268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:34.271539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:34.272241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:34.272541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:34.273911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:34.285140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 631/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:34.290467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:34.320546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:34.388853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ab02a-94b5-479b-9db6-381edf23bb7e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:34.420791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:34.421591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:34.421876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:34.422150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:34.428642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:34.430115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:09:34.445129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:34.446112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:34.447012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 640/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:09:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:34.452742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:34.508753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:34.549224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa35b1e-78d8-4e2c-ba1f-8c423f83c2bd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:34.581598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad66c-a666-4eeb-9c45-fc30a6fd4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:34.582176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad66c-a666-4eeb-9c45-fc30a6fd4260 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:34.582459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad66c-a666-4eeb-9c45-fc30a6fd4260 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:34.582728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad66c-a666-4eeb-9c45-fc30a6fd4260 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:34.583498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad66c-a666-4eeb-9c45-fc30a6fd4260 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:34.583803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad66c-a666-4eeb-9c45-fc30a6fd4260 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:34.585237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad66c-a666-4eeb-9c45-fc30a6fd4260 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:34.596975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 632/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:09:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:34.602805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:34.689594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:34.698650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a353d7-ec97-4309-904d-4227a746358e None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:34.731035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014b451-b4b7-4596-bbdc-bfb95a18c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:34.731902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014b451-b4b7-4596-bbdc-bfb95a18c7f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:34.732182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014b451-b4b7-4596-bbdc-bfb95a18c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:34.732462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014b451-b4b7-4596-bbdc-bfb95a18c7f7 None admin] PATH_INFO: `/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/eaaa0a5f15ee4338a750795e4abbb64d/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:34.734409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014b451-b4b7-4596-bbdc-bfb95a18c7f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a790e3a63e7e4e2b8ba693d6331e81c4, user_id=eaaa0a5f15ee4338a750795e4abbb64d, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:34.735832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014b451-b4b7-4596-bbdc-bfb95a18c7f7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:34.748603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 641/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Thu Jun 30 13:09:34 2022] PUT /identity/v3/projects/a790e3a63e7e4e2b8ba693d6331e81c4/users/eaaa0a5f15ee4338a750795e4abbb64d/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:09:36.736471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d26f5-ff43-4103-a8f5-bb5050c6c8de None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:36.736981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d26f5-ff43-4103-a8f5-bb5050c6c8de None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:36.737074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d26f5-ff43-4103-a8f5-bb5050c6c8de None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:36.738451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 633/1274] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:36.743511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321bdcd-2eeb-4502-9342-d8172cf57d5a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:36.743909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321bdcd-2eeb-4502-9342-d8172cf57d5a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:36.744062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321bdcd-2eeb-4502-9342-d8172cf57d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:36.760190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3321bdcd-2eeb-4502-9342-d8172cf57d5a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:36.761352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3321bdcd-2eeb-4502-9342-d8172cf57d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:36.824711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 642/1275] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:36.848031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d26f5-ff43-4103-a8f5-bb5050c6c8de None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:36.946654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d26f5-ff43-4103-a8f5-bb5050c6c8de None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:36.964045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:36.981194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:36.981994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:36.982283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:36.982558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:36.992483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 13:09:37.000071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:37.001156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:37.002394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 634/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Thu Jun 30 13:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:37.006975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321bdcd-2eeb-4502-9342-d8172cf57d5a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:37.085083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:37.105545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321bdcd-2eeb-4502-9342-d8172cf57d5a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:37.143343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:37.144002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:37.144281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:37.144550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:37.145285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:37.145622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:37.146974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:37.155364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 643/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Thu Jun 30 13:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:37.161009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:37.257649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca5b7e-afb0-472d-8c82-e631b047067d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:37.290572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:37.291340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:37.291650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:37.291925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:37.302149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:37.303570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:37.320015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:37.320919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:37.321859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:37.321859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:37.321859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:37.321859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:37.321859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 635/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:37.327239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:37.423051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d9b5-583f-4d1b-b26a-39a00360f1de None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:37.455453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:37.456099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:37.456381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:37.456654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:37.457361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:37.457692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:37.459038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:37.470456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 644/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:37.476027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:37.506209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:37.573681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce780-f3a3-430b-a5c0-db43ea305b31 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:37.606261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:37.607037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:37.607314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:37.607584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:37.615534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:37.616952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 13:09:37.631245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:37.632373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:37.633596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 636/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:37.640762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:37.644423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:37.736655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae9034-a2f2-4be5-83c8-d544f6f00a70 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:37.768988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:37.769670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:37.769951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:37.770223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:37.771041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:37.771346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:37.772744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:37.789696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 645/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Thu Jun 30 13:09:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:37.795699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:37.883263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:37.892744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804b32c-b4fe-4fe2-b69d-bfd81eaefff8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:37.924745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:37.925375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:37.925709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:37.925972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:37.990416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:37.991839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:38.076207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:38.086332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 637/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Thu Jun 30 13:09:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 13:09:38.092650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:38.156109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:38.193116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e985a-78f8-40a4-bdbb-cdb66c1d26f7 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:38.225971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:38.226745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:38.227021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:38.227290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:38.237534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:38.238945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 13:09:38.255665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:38.256717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:38.257852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 13:09:38.257852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 13:09:38.257852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 13:09:38.257852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:38.257852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 646/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:38.262469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:38.359309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c828-3ea4-4cc3-ace5-936c58cc5ae5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:38.391548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:38.392188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:38.392467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:38.392762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:38.393491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:38.393799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:38.395144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:38.406474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 638/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Thu Jun 30 13:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:38.412002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:38.508375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f432-4606-4fee-9f51-11a7929ab88d None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:38.522396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:38.543471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:38.544248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:38.544531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:38.544804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:38.551222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:38.552649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 13:09:38.566122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:38.567148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: ERROR keystone.server.flask.application Jun 30 13:09:38.568320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 647/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Thu Jun 30 13:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:38.573051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:38.622306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:38.671192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd33fd-4780-486a-8ed1-3f141f11f994 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:38.702957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55458c6-eb04-46f6-b176-3f5e54e853ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:38.703593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55458c6-eb04-46f6-b176-3f5e54e853ee None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:38.703874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55458c6-eb04-46f6-b176-3f5e54e853ee None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:38.704149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55458c6-eb04-46f6-b176-3f5e54e853ee None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:38.704922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55458c6-eb04-46f6-b176-3f5e54e853ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:38.705230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55458c6-eb04-46f6-b176-3f5e54e853ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:38.706678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55458c6-eb04-46f6-b176-3f5e54e853ee None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:38.719122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 639/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Thu Jun 30 13:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:38.725105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:38.819573 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffdef3-4942-4fbb-975a-8529aa56a79a None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:38.852313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a821b-fa43-46b5-9450-9fa5c15be6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:38.852939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a821b-fa43-46b5-9450-9fa5c15be6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:38.853221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a821b-fa43-46b5-9450-9fa5c15be6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:38.853521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a821b-fa43-46b5-9450-9fa5c15be6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:38.854336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a821b-fa43-46b5-9450-9fa5c15be6d4 None admin] RBAC: Adding query filter params (role.id=e63cac3eb6e14081b96e468e268bdb09, scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4, user.id=eaaa0a5f15ee4338a750795e4abbb64d) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:38.854649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a821b-fa43-46b5-9450-9fa5c15be6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:38.856089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a821b-fa43-46b5-9450-9fa5c15be6d4 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:38.861730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 648/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Thu Jun 30 13:09:38 2022] GET /identity/v3/role_assignments?user.id=eaaa0a5f15ee4338a750795e4abbb64d&scope.project.id=a790e3a63e7e4e2b8ba693d6331e81c4&role.id=e63cac3eb6e14081b96e468e268bdb09 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:40.872086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc0eac-f002-43af-9894-73dd6fba2ef3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:40.872633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc0eac-f002-43af-9894-73dd6fba2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:40.872633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc0eac-f002-43af-9894-73dd6fba2ef3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:40.874017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 640/1288] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:40.878999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a0fcf-71ae-4d8a-8094-7b687d34ec4e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:40.879382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a0fcf-71ae-4d8a-8094-7b687d34ec4e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:40.879564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a0fcf-71ae-4d8a-8094-7b687d34ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:40.896368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3a2a0fcf-71ae-4d8a-8094-7b687d34ec4e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:40.897613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3a2a0fcf-71ae-4d8a-8094-7b687d34ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:40.926364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:40.962176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 649/1289] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:40.985147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc0eac-f002-43af-9894-73dd6fba2ef3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:41.083551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc0eac-f002-43af-9894-73dd6fba2ef3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:41.095476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:41.123661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:41.124568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:41.124859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:41.125313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:41.126008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:41.127509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:41.141985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:41.143210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:41.144228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 641/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:09:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:41.151894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a0fcf-71ae-4d8a-8094-7b687d34ec4e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:41.252472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a0fcf-71ae-4d8a-8094-7b687d34ec4e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:41.285178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ca5b1-b71a-4ea5-99f5-3c2cd383d325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:41.285855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca5b1-b71a-4ea5-99f5-3c2cd383d325 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:41.286141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca5b1-b71a-4ea5-99f5-3c2cd383d325 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:41.286418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca5b1-b71a-4ea5-99f5-3c2cd383d325 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:41.287114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ca5b1-b71a-4ea5-99f5-3c2cd383d325 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:41.287419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ca5b1-b71a-4ea5-99f5-3c2cd383d325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:41.288772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ca5b1-b71a-4ea5-99f5-3c2cd383d325 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:41.293533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 650/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Thu Jun 30 13:09:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:41.299377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:41.397233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ffbf-6843-4afd-97c6-3608d564b32f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:41.429179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb7015-7dda-4f7b-9f5b-7919c3942396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:41.429864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7015-7dda-4f7b-9f5b-7919c3942396 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:41.430149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7015-7dda-4f7b-9f5b-7919c3942396 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:41.430424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7015-7dda-4f7b-9f5b-7919c3942396 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:41.431116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb7015-7dda-4f7b-9f5b-7919c3942396 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:41.431421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb7015-7dda-4f7b-9f5b-7919c3942396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:41.432768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb7015-7dda-4f7b-9f5b-7919c3942396 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:41.437674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 642/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Thu Jun 30 13:09:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:43.414735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b864-1db7-4482-83cf-d115b475a9be None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:43.415190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b864-1db7-4482-83cf-d115b475a9be None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:43.415302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b864-1db7-4482-83cf-d115b475a9be None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:43.416646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 651/1293] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:43.421650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb224-e227-4ef7-9a3e-0ce3cfde396a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:43.422070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb224-e227-4ef7-9a3e-0ce3cfde396a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:43.422209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb224-e227-4ef7-9a3e-0ce3cfde396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:43.439052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-248cb224-e227-4ef7-9a3e-0ce3cfde396a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:43.440219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-248cb224-e227-4ef7-9a3e-0ce3cfde396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:43.469053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:43.504912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 643/1294] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:43.527634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b864-1db7-4482-83cf-d115b475a9be None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:43.557431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:43.626987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b864-1db7-4482-83cf-d115b475a9be None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:43.659270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abc4ff-1424-4333-9fe1-0e6c5f27d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:43.659913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abc4ff-1424-4333-9fe1-0e6c5f27d91c None admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:43.660195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abc4ff-1424-4333-9fe1-0e6c5f27d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:43.660466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abc4ff-1424-4333-9fe1-0e6c5f27d91c None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:43.661169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abc4ff-1424-4333-9fe1-0e6c5f27d91c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:43.662569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abc4ff-1424-4333-9fe1-0e6c5f27d91c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:43.675224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 652/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Thu Jun 30 13:09:43 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:09:45.693598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639562a1-bb78-43f0-8170-2a0370c565b3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:45.694100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639562a1-bb78-43f0-8170-2a0370c565b3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:45.694100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639562a1-bb78-43f0-8170-2a0370c565b3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:45.695441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 644/1296] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:45.701017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13adff-5c87-427e-89b8-cf31e3c9b022 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:45.701388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13adff-5c87-427e-89b8-cf31e3c9b022 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:45.701602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13adff-5c87-427e-89b8-cf31e3c9b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:45.718112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-be13adff-5c87-427e-89b8-cf31e3c9b022 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:45.719302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-be13adff-5c87-427e-89b8-cf31e3c9b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:45.788803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 653/1297] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 13:09:45.812108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639562a1-bb78-43f0-8170-2a0370c565b3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:45.910800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639562a1-bb78-43f0-8170-2a0370c565b3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:45.943507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:45.944326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:45.944563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:45.944840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:45.945508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:45.946873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:45.959000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:45.960144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:45.961285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 645/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:09:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:45.966075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13adff-5c87-427e-89b8-cf31e3c9b022 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:45.984078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:46.062768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13adff-5c87-427e-89b8-cf31e3c9b022 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:46.094750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:46.095393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:46.095675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:46.095948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:46.096634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:46.096938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:46.098311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:46.105896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 654/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Thu Jun 30 13:09:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:46.114244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:46.152491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:46.222323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4498163-e23f-4063-a0a4-bf8fe9897cd1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:46.254831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf4361-a178-41bf-9f54-f9c6c93945d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:46.255475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4361-a178-41bf-9f54-f9c6c93945d9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:46.255755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4361-a178-41bf-9f54-f9c6c93945d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:46.256030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4361-a178-41bf-9f54-f9c6c93945d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:46.256804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf4361-a178-41bf-9f54-f9c6c93945d9 None admin] RBAC: Adding query filter params (interface=public, service_id=c260bffdc06c4932af84a98f37f2571f, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:46.257112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf4361-a178-41bf-9f54-f9c6c93945d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:46.258490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf4361-a178-41bf-9f54-f9c6c93945d9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:46.263342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 646/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Thu Jun 30 13:09:46 2022] GET /identity/v3/endpoints?service_id=c260bffdc06c4932af84a98f37f2571f&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:46.269033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:46.347880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:46.367032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5d15a-a332-420a-8fc4-e4c61629d008 None admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:46.398875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80ece-88f5-4f50-b71c-5387a54b6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:46.399522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80ece-88f5-4f50-b71c-5387a54b6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:46.399803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80ece-88f5-4f50-b71c-5387a54b6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:46.400078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80ece-88f5-4f50-b71c-5387a54b6a4c None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:46.400774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80ece-88f5-4f50-b71c-5387a54b6a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:46.402697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80ece-88f5-4f50-b71c-5387a54b6a4c None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:46.409374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 655/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Thu Jun 30 13:09:46 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:09:48.406669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9477d-09fe-4ba6-a5bc-4044f3422f72 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:48.407163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9477d-09fe-4ba6-a5bc-4044f3422f72 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:48.407261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9477d-09fe-4ba6-a5bc-4044f3422f72 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:48.408578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 647/1302] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:09:48.413738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c441-994f-4d85-9c45-0fb64b4e3066 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:48.414184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c441-994f-4d85-9c45-0fb64b4e3066 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:48.414284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c441-994f-4d85-9c45-0fb64b4e3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:48.430565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-fcd7c441-994f-4d85-9c45-0fb64b4e3066 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:09:48.431760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fcd7c441-994f-4d85-9c45-0fb64b4e3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:09:48.495710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 656/1303] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:09:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 13:09:48.518355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9477d-09fe-4ba6-a5bc-4044f3422f72 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:48.610744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:48.617801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9477d-09fe-4ba6-a5bc-4044f3422f72 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:48.650492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:48.651267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:48.651548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:48.651820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:48.652484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:48.653867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 13:09:48.665324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 13:09:48.669625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Jun 30 13:09:48.670766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 648/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Thu Jun 30 13:09:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 13:09:48.672533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7c441-994f-4d85-9c45-0fb64b4e3066 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:48.745156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:48.769277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7c441-994f-4d85-9c45-0fb64b4e3066 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:48.801467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a8c6e-5b2f-4451-88e5-27d0dcc46489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:48.802195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a8c6e-5b2f-4451-88e5-27d0dcc46489 None admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:48.802503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a8c6e-5b2f-4451-88e5-27d0dcc46489 None admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:48.802777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a8c6e-5b2f-4451-88e5-27d0dcc46489 None admin] PATH_INFO: `/v3/services` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:48.803466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a8c6e-5b2f-4451-88e5-27d0dcc46489 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:09:48.803769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a8c6e-5b2f-4451-88e5-27d0dcc46489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:48.805119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a8c6e-5b2f-4451-88e5-27d0dcc46489 None admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:48.810669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 657/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Thu Jun 30 13:09:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:09:48.816071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:09:48.913743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e5ad-c98b-44bc-9c02-545e163cd30a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:09:48.945696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361817e-9026-4f92-a182-f788c64dc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:09:48.946326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361817e-9026-4f92-a182-f788c64dc47c None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:09:48.946610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361817e-9026-4f92-a182-f788c64dc47c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:09:48.946886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361817e-9026-4f92-a182-f788c64dc47c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:09:48.947625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361817e-9026-4f92-a182-f788c64dc47c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:09:48.948969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361817e-9026-4f92-a182-f788c64dc47c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:09:48.967093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 649/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Thu Jun 30 13:09:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:09:58.807662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=30 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:58.962604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:51.169882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57f2ef-9f65-4ab6-840f-4317b1cf5da3 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:51.170348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57f2ef-9f65-4ab6-840f-4317b1cf5da3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:51.170348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57f2ef-9f65-4ab6-840f-4317b1cf5da3 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:51.176831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc901ba-bba1-4e03-ba51-889107088122 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:51.177246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc901ba-bba1-4e03-ba51-889107088122 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:51.177385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc901ba-bba1-4e03-ba51-889107088122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:51.179536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 658/1307] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:10:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:10:51.251510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8fc901ba-bba1-4e03-ba51-889107088122 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:10:51.252711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8fc901ba-bba1-4e03-ba51-889107088122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:51.369675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 650/1308] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:10:51.422348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82057c27-7cce-47cb-9b50-8c641a3b824c None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:51.422640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82057c27-7cce-47cb-9b50-8c641a3b824c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:51.423004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82057c27-7cce-47cb-9b50-8c641a3b824c None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:51.424276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 659/1309] 10.222.0.47 () {54 vars in 964 bytes} [Thu Jun 30 13:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:10:51.435179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07562b7-103c-44cb-b5ae-8b37ed51af93 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:51.435469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07562b7-103c-44cb-b5ae-8b37ed51af93 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:51.435750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07562b7-103c-44cb-b5ae-8b37ed51af93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:51.590388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d07562b7-103c-44cb-b5ae-8b37ed51af93 None None] MFA Rules not processed for user `98a5a31ddbe04b2490689adcbe76f9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:10:51.591972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d07562b7-103c-44cb-b5ae-8b37ed51af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:51.617181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:51.679599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 651/1310] 10.222.0.47 () {58 vars in 1061 bytes} [Thu Jun 30 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:10:51.689762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82057c27-7cce-47cb-9b50-8c641a3b824c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:10:51.691793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-82057c27-7cce-47cb-9b50-8c641a3b824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:51.811242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82057c27-7cce-47cb-9b50-8c641a3b824c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:10:51.887981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d15b75-8d87-4fd4-bbf2-fcf59401fb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:10:51.888892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d15b75-8d87-4fd4-bbf2-fcf59401fb55 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:51.889352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d15b75-8d87-4fd4-bbf2-fcf59401fb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:51.889798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d15b75-8d87-4fd4-bbf2-fcf59401fb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:51.891624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-48d15b75-8d87-4fd4-bbf2-fcf59401fb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:51.948744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:52.013266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d15b75-8d87-4fd4-bbf2-fcf59401fb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:10:52.015333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d15b75-8d87-4fd4-bbf2-fcf59401fb55 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:10:52.037028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 660/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:10:54.400154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340c8f9-5b55-422b-863a-ab643f072888 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:54.400696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340c8f9-5b55-422b-863a-ab643f072888 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:54.400696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340c8f9-5b55-422b-863a-ab643f072888 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:54.402117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 652/1312] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:10:54.407162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a132-57f2-44aa-9ba7-630f357977d6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:54.407572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a132-57f2-44aa-9ba7-630f357977d6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:54.407755 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a132-57f2-44aa-9ba7-630f357977d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:54.486684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7e66a132-57f2-44aa-9ba7-630f357977d6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:10:54.487880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7e66a132-57f2-44aa-9ba7-630f357977d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:54.585389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 661/1313] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:10:54.623877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340c8f9-5b55-422b-863a-ab643f072888 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:10:54.625507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d340c8f9-5b55-422b-863a-ab643f072888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:54.736835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340c8f9-5b55-422b-863a-ab643f072888 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:10:54.813878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:54.816962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5b2a4-466c-4cfe-ba2e-6586741a58b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:10:54.817819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b2a4-466c-4cfe-ba2e-6586741a58b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:54.818341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b2a4-466c-4cfe-ba2e-6586741a58b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:54.818628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b2a4-466c-4cfe-ba2e-6586741a58b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:54.820344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e5f5b2a4-466c-4cfe-ba2e-6586741a58b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:54.930238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5b2a4-466c-4cfe-ba2e-6586741a58b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:10:54.931605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5b2a4-466c-4cfe-ba2e-6586741a58b7 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:10:54.949324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 653/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:10:57.254710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644cf1-29a7-461b-9eeb-e78887ebbe10 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:57.255238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644cf1-29a7-461b-9eeb-e78887ebbe10 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:57.255238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644cf1-29a7-461b-9eeb-e78887ebbe10 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:57.256626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 662/1315] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:10:57.261694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc854-b397-4d6d-9876-141024ba34b3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:57.262119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc854-b397-4d6d-9876-141024ba34b3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:57.262239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc854-b397-4d6d-9876-141024ba34b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:57.325169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-99acc854-b397-4d6d-9876-141024ba34b3 None None] MFA Rules not processed for user `902653d053d145c0a81595daf27e2533`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:10:57.326300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-99acc854-b397-4d6d-9876-141024ba34b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:57.378555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:57.422701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 654/1316] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:10:57.462015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43644cf1-29a7-461b-9eeb-e78887ebbe10 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:10:57.463832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-43644cf1-29a7-461b-9eeb-e78887ebbe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:57.473373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:57.565134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43644cf1-29a7-461b-9eeb-e78887ebbe10 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:10:57.636443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02053a-5d98-4d22-a89f-1fbdb8c36226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:10:57.637023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02053a-5d98-4d22-a89f-1fbdb8c36226 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:57.637307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02053a-5d98-4d22-a89f-1fbdb8c36226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:57.637620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02053a-5d98-4d22-a89f-1fbdb8c36226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:57.639257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1d02053a-5d98-4d22-a89f-1fbdb8c36226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:57.699532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:57.746820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02053a-5d98-4d22-a89f-1fbdb8c36226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:10:57.748241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02053a-5d98-4d22-a89f-1fbdb8c36226 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:10:57.765792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 663/1317] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:10:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:00.292858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e85cf-69e1-4b41-9729-2763586f5df6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:00.293422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e85cf-69e1-4b41-9729-2763586f5df6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:00.293422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e85cf-69e1-4b41-9729-2763586f5df6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:00.294810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 655/1318] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:00.299839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a2389-eff0-4971-b227-d36b362d1d2b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:00.300259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a2389-eff0-4971-b227-d36b362d1d2b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:00.300396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a2389-eff0-4971-b227-d36b362d1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:00.363331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-220a2389-eff0-4971-b227-d36b362d1d2b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:00.364533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-220a2389-eff0-4971-b227-d36b362d1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:00.457589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 664/1319] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:00.496184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e85cf-69e1-4b41-9729-2763586f5df6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:00.497716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-552e85cf-69e1-4b41-9729-2763586f5df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:00.597875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e85cf-69e1-4b41-9729-2763586f5df6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:00.668508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb7c88-0c58-4c43-80a8-b0bc574ab96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:00.669142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb7c88-0c58-4c43-80a8-b0bc574ab96c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:00.669423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb7c88-0c58-4c43-80a8-b0bc574ab96c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:00.669725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb7c88-0c58-4c43-80a8-b0bc574ab96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:00.671328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c9eb7c88-0c58-4c43-80a8-b0bc574ab96c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:00.678481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:00.778726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb7c88-0c58-4c43-80a8-b0bc574ab96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:00.780128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb7c88-0c58-4c43-80a8-b0bc574ab96c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:00.797571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 656/1320] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:03.446015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d2792-225b-4b22-a7bf-8962dde90fe1 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:03.446539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d2792-225b-4b22-a7bf-8962dde90fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:03.446539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d2792-225b-4b22-a7bf-8962dde90fe1 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:03.448449 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 665/1321] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:03.453709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad51dd-204b-44f8-926c-6c7d0ce29ceb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:03.454129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad51dd-204b-44f8-926c-6c7d0ce29ceb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:03.454279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad51dd-204b-44f8-926c-6c7d0ce29ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:03.519206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d2ad51dd-204b-44f8-926c-6c7d0ce29ceb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:03.520568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d2ad51dd-204b-44f8-926c-6c7d0ce29ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:03.578547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:03.626582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 657/1322] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:11:03.662670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d2792-225b-4b22-a7bf-8962dde90fe1 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:03.664229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-008d2792-225b-4b22-a7bf-8962dde90fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:03.684231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:03.774311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d2792-225b-4b22-a7bf-8962dde90fe1 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:03.847964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bc8ec-9de2-4535-9a24-cc1cb76aa558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:03.848607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bc8ec-9de2-4535-9a24-cc1cb76aa558 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:03.848885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bc8ec-9de2-4535-9a24-cc1cb76aa558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:03.849156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bc8ec-9de2-4535-9a24-cc1cb76aa558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:03.850811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9d2bc8ec-9de2-4535-9a24-cc1cb76aa558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:03.919952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:03.957884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bc8ec-9de2-4535-9a24-cc1cb76aa558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:03.959317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bc8ec-9de2-4535-9a24-cc1cb76aa558 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:03.977245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 666/1323] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:06.039704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2ae3-7899-4d4a-a0b0-ba2781c9ad60 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:06.040238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2ae3-7899-4d4a-a0b0-ba2781c9ad60 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:06.040327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2ae3-7899-4d4a-a0b0-ba2781c9ad60 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:06.041786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 658/1324] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:06.046951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77b631-4150-4eb4-97e5-0fa1f13e9d3f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:06.047358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77b631-4150-4eb4-97e5-0fa1f13e9d3f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:06.047507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77b631-4150-4eb4-97e5-0fa1f13e9d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:06.114610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4b77b631-4150-4eb4-97e5-0fa1f13e9d3f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:06.115773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4b77b631-4150-4eb4-97e5-0fa1f13e9d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:06.210436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 667/1325] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:06.262131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc881e-3656-4093-bd56-95aaa6ec054c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:06.262416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc881e-3656-4093-bd56-95aaa6ec054c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:06.262717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc881e-3656-4093-bd56-95aaa6ec054c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:06.264104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 659/1326] 10.222.0.47 () {54 vars in 964 bytes} [Thu Jun 30 13:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:06.270089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ccbab-8036-48a6-b96b-32facf351d04 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:06.270385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ccbab-8036-48a6-b96b-32facf351d04 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:06.270670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ccbab-8036-48a6-b96b-32facf351d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:06.299966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:06.346568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-950ccbab-8036-48a6-b96b-32facf351d04 None None] MFA Rules not processed for user `98a5a31ddbe04b2490689adcbe76f9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:06.347782 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-950ccbab-8036-48a6-b96b-32facf351d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:06.423713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 668/1327] 10.222.0.47 () {58 vars in 1061 bytes} [Thu Jun 30 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:11:06.433820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc881e-3656-4093-bd56-95aaa6ec054c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:06.435327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c6fc881e-3656-4093-bd56-95aaa6ec054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:06.541824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc881e-3656-4093-bd56-95aaa6ec054c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:06.615025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0f4a5-fc69-48ed-9240-fa76f8a1d97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:06.615665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f4a5-fc69-48ed-9240-fa76f8a1d97c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:06.615944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f4a5-fc69-48ed-9240-fa76f8a1d97c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:06.616216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f4a5-fc69-48ed-9240-fa76f8a1d97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:06.617843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-95a0f4a5-fc69-48ed-9240-fa76f8a1d97c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:06.642030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:06.736614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0f4a5-fc69-48ed-9240-fa76f8a1d97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:06.738081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0f4a5-fc69-48ed-9240-fa76f8a1d97c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:06.756835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 660/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:09.043550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ff08-c041-499f-afdb-78b12c33cf76 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:09.044078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ff08-c041-499f-afdb-78b12c33cf76 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:09.044078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ff08-c041-499f-afdb-78b12c33cf76 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:09.045543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 669/1329] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:09.050807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d87c1-b1c0-40a9-806b-139090da6ce1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:09.051242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d87c1-b1c0-40a9-806b-139090da6ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:09.051362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d87c1-b1c0-40a9-806b-139090da6ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:09.118227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3a0d87c1-b1c0-40a9-806b-139090da6ce1 None None] MFA Rules not processed for user `902653d053d145c0a81595daf27e2533`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:09.119455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a0d87c1-b1c0-40a9-806b-139090da6ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:09.183969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:09.233701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 661/1330] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:09.271266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978ff08-c041-499f-afdb-78b12c33cf76 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:09.272821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7978ff08-c041-499f-afdb-78b12c33cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:09.381637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978ff08-c041-499f-afdb-78b12c33cf76 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:09.401602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:09.455015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d79489-d315-429a-b184-ff3efa14f091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:09.455661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d79489-d315-429a-b184-ff3efa14f091 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:09.455978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d79489-d315-429a-b184-ff3efa14f091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:09.456260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d79489-d315-429a-b184-ff3efa14f091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:09.457967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f4d79489-d315-429a-b184-ff3efa14f091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:09.566268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d79489-d315-429a-b184-ff3efa14f091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:09.567803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d79489-d315-429a-b184-ff3efa14f091 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:09.586047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 670/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:12.009859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ae00-5b7a-46a1-811a-7782fe5e31bc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:12.010909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ae00-5b7a-46a1-811a-7782fe5e31bc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:12.011023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ae00-5b7a-46a1-811a-7782fe5e31bc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:12.012308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 662/1332] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:12.017592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9990c-f3c9-430d-aeec-8a42432a6917 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:12.018003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9990c-f3c9-430d-aeec-8a42432a6917 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:12.018155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9990c-f3c9-430d-aeec-8a42432a6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:12.078299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:12.081142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-18a9990c-f3c9-430d-aeec-8a42432a6917 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:12.082906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-18a9990c-f3c9-430d-aeec-8a42432a6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:12.178553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 671/1333] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:12.214230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ae00-5b7a-46a1-811a-7782fe5e31bc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:12.215814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fbd6ae00-5b7a-46a1-811a-7782fe5e31bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:12.317387 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ae00-5b7a-46a1-811a-7782fe5e31bc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:12.394214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc8e5-4483-4da8-8349-bdd6809e1c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:12.394860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc8e5-4483-4da8-8349-bdd6809e1c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:12.395146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc8e5-4483-4da8-8349-bdd6809e1c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:12.395421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc8e5-4483-4da8-8349-bdd6809e1c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:12.397087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a49bc8e5-4483-4da8-8349-bdd6809e1c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:12.424282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:12.503956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc8e5-4483-4da8-8349-bdd6809e1c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:12.505365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc8e5-4483-4da8-8349-bdd6809e1c69 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:12.522627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 663/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:14.556684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445139-1a35-4c35-b6f7-d69ee8d733a7 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:14.557792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445139-1a35-4c35-b6f7-d69ee8d733a7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:14.557792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445139-1a35-4c35-b6f7-d69ee8d733a7 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:14.559180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 672/1335] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:14.564166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96a866-bb9f-41b9-87b1-7455d1bf9a5c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:14.564582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96a866-bb9f-41b9-87b1-7455d1bf9a5c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:14.564717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96a866-bb9f-41b9-87b1-7455d1bf9a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:14.628216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8e96a866-bb9f-41b9-87b1-7455d1bf9a5c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:14.629326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8e96a866-bb9f-41b9-87b1-7455d1bf9a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:14.703278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:14.725487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 664/1336] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:14.765128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df445139-1a35-4c35-b6f7-d69ee8d733a7 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:14.766735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-df445139-1a35-4c35-b6f7-d69ee8d733a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:14.868009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df445139-1a35-4c35-b6f7-d69ee8d733a7 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:14.895805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:14.940236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6c050-7817-4286-b627-7d7330a7604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:14.940883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6c050-7817-4286-b627-7d7330a7604a service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:14.941166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6c050-7817-4286-b627-7d7330a7604a service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:14.941441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6c050-7817-4286-b627-7d7330a7604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:14.943103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d9c6c050-7817-4286-b627-7d7330a7604a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:15.048638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6c050-7817-4286-b627-7d7330a7604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:15.050098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6c050-7817-4286-b627-7d7330a7604a service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:15.068006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 673/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:17.510564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b83dc-9590-4a5d-997e-a6f49e3ae154 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:17.511122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b83dc-9590-4a5d-997e-a6f49e3ae154 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:17.511122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b83dc-9590-4a5d-997e-a6f49e3ae154 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:17.512465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 665/1338] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:17.517506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8481-faa4-4a5a-a3fd-d07cf6f9faa3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:17.517931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8481-faa4-4a5a-a3fd-d07cf6f9faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:17.518053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8481-faa4-4a5a-a3fd-d07cf6f9faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:17.581306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8b9e8481-faa4-4a5a-a3fd-d07cf6f9faa3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:17.582541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8b9e8481-faa4-4a5a-a3fd-d07cf6f9faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:17.591150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:17.678312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 674/1339] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:17.714020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b83dc-9590-4a5d-997e-a6f49e3ae154 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:17.715565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c10b83dc-9590-4a5d-997e-a6f49e3ae154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:17.816574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b83dc-9590-4a5d-997e-a6f49e3ae154 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:17.887663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac6582-c4a2-400c-ba92-6accd3e0c26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:17.888294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6582-c4a2-400c-ba92-6accd3e0c26c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:17.888574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6582-c4a2-400c-ba92-6accd3e0c26c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:17.888846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6582-c4a2-400c-ba92-6accd3e0c26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:17.890548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-83ac6582-c4a2-400c-ba92-6accd3e0c26c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:17.925907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:17.997916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac6582-c4a2-400c-ba92-6accd3e0c26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:17.999333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac6582-c4a2-400c-ba92-6accd3e0c26c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:18.017233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 666/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:21.939151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521797b-9c4b-4bdb-9ac5-84da1980f515 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:21.939728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521797b-9c4b-4bdb-9ac5-84da1980f515 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:21.939728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521797b-9c4b-4bdb-9ac5-84da1980f515 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:21.941241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 675/1341] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:21.946373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f500d-a45d-402c-beca-24c4d3a2761a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:21.946807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f500d-a45d-402c-beca-24c4d3a2761a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:21.947017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f500d-a45d-402c-beca-24c4d3a2761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:22.018349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4f0f500d-a45d-402c-beca-24c4d3a2761a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:22.019542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4f0f500d-a45d-402c-beca-24c4d3a2761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:22.113346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:22.127577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 667/1342] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:22.166084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521797b-9c4b-4bdb-9ac5-84da1980f515 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:22.168349 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9521797b-9c4b-4bdb-9ac5-84da1980f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:22.262024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521797b-9c4b-4bdb-9ac5-84da1980f515 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:22.265528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189590c0-1536-4a37-8553-75ac8730bc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:22.266174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189590c0-1536-4a37-8553-75ac8730bc61 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:22.266455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189590c0-1536-4a37-8553-75ac8730bc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:22.266750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189590c0-1536-4a37-8553-75ac8730bc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:22.275730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189590c0-1536-4a37-8553-75ac8730bc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:22.277163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189590c0-1536-4a37-8553-75ac8730bc61 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:22.286746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 676/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:25.026101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c147a-7ae2-4857-87db-b4eb97f21f7d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:25.026685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c147a-7ae2-4857-87db-b4eb97f21f7d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:25.026685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c147a-7ae2-4857-87db-b4eb97f21f7d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:25.028169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 668/1344] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:25.033146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9cc33-e13f-4786-b8b7-41b775924b23 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:25.033571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9cc33-e13f-4786-b8b7-41b775924b23 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:25.033732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9cc33-e13f-4786-b8b7-41b775924b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:25.062035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-14a9cc33-e13f-4786-b8b7-41b775924b23 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:25.063264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-14a9cc33-e13f-4786-b8b7-41b775924b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:25.095869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:25.153744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 677/1345] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:25.196327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c147a-7ae2-4857-87db-b4eb97f21f7d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:25.207443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c147a-7ae2-4857-87db-b4eb97f21f7d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:25.210969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3fcf2-98cc-464f-a7ed-4c2ccf9974fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:25.211627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3fcf2-98cc-464f-a7ed-4c2ccf9974fc service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:25.211912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3fcf2-98cc-464f-a7ed-4c2ccf9974fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:25.212191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3fcf2-98cc-464f-a7ed-4c2ccf9974fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:25.222457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3fcf2-98cc-464f-a7ed-4c2ccf9974fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:25.223893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3fcf2-98cc-464f-a7ed-4c2ccf9974fc service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:25.234290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 669/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:29.377159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1e1-93a0-4a90-b35a-dba45dc5f8e0 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:29.377652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1e1-93a0-4a90-b35a-dba45dc5f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:29.377797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1e1-93a0-4a90-b35a-dba45dc5f8e0 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:29.379313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 678/1347] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:29.384534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3c85-c9be-4486-a8b8-d3aa67c847d0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:29.384981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3c85-c9be-4486-a8b8-d3aa67c847d0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:29.385089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3c85-c9be-4486-a8b8-d3aa67c847d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:29.403921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-365e3c85-c9be-4486-a8b8-d3aa67c847d0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:29.405138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-365e3c85-c9be-4486-a8b8-d3aa67c847d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:29.413053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 670/1348] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:11:29.452208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f1e1-93a0-4a90-b35a-dba45dc5f8e0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:29.462634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f1e1-93a0-4a90-b35a-dba45dc5f8e0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:29.466439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cd759-ad2f-41f7-98dc-bdb79af0a555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:29.467073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cd759-ad2f-41f7-98dc-bdb79af0a555 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:29.467358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cd759-ad2f-41f7-98dc-bdb79af0a555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:29.467635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cd759-ad2f-41f7-98dc-bdb79af0a555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:29.476741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cd759-ad2f-41f7-98dc-bdb79af0a555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:29.478206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cd759-ad2f-41f7-98dc-bdb79af0a555 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:29.488314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 679/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:34.484235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3722a-7310-4ba8-b85f-477040cb2be9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:34.485039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3722a-7310-4ba8-b85f-477040cb2be9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:34.485499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3722a-7310-4ba8-b85f-477040cb2be9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:34.487291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 671/1350] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:34.492637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4014b7-e11f-401b-a6ff-bf5a0e29d54e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:34.493018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4014b7-e11f-401b-a6ff-bf5a0e29d54e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:34.493198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4014b7-e11f-401b-a6ff-bf5a0e29d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:34.613286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4b4014b7-e11f-401b-a6ff-bf5a0e29d54e None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:34.620803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4b4014b7-e11f-401b-a6ff-bf5a0e29d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:34.720124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 680/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:38.887798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f318be-9dfd-49bd-84ed-c21ab69f47aa None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:38.888306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f318be-9dfd-49bd-84ed-c21ab69f47aa None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:38.888404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f318be-9dfd-49bd-84ed-c21ab69f47aa None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:38.889906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 672/1352] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:38.894684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39d10-418c-493d-a30d-2b85160dd992 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:38.895136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39d10-418c-493d-a30d-2b85160dd992 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:38.895442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39d10-418c-493d-a30d-2b85160dd992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:38.914659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-cba39d10-418c-493d-a30d-2b85160dd992 None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:38.915987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-cba39d10-418c-493d-a30d-2b85160dd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:38.924885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 681/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:39.397453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=13 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:40.393497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787b27-b3e5-4564-b717-ebac171d8eb9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:40.394112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787b27-b3e5-4564-b717-ebac171d8eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:40.394112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787b27-b3e5-4564-b717-ebac171d8eb9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:40.395682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 673/1354] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:40.401039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711911f9-2bff-4468-830a-0cba71b3e2a4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:40.401534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711911f9-2bff-4468-830a-0cba71b3e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:40.401632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711911f9-2bff-4468-830a-0cba71b3e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:40.419545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-711911f9-2bff-4468-830a-0cba71b3e2a4 None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:40.420733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-711911f9-2bff-4468-830a-0cba71b3e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:40.429261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 682/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:44.023144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36926e-6504-4107-be80-7665ce370eab None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:44.023999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36926e-6504-4107-be80-7665ce370eab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:44.024431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36926e-6504-4107-be80-7665ce370eab None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:44.027718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 674/1356] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:44.035501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2276-e906-4773-83a8-c63731ffe3e2 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:44.036336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2276-e906-4773-83a8-c63731ffe3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:44.037322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2276-e906-4773-83a8-c63731ffe3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:44.059872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a67e2276-e906-4773-83a8-c63731ffe3e2 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:44.061090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a67e2276-e906-4773-83a8-c63731ffe3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:44.069519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 683/1357] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:44.131836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944bff-a1fe-475e-b4c0-9bb4ca848ccb None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:44.132336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944bff-a1fe-475e-b4c0-9bb4ca848ccb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:44.132768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944bff-a1fe-475e-b4c0-9bb4ca848ccb None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:44.134313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 675/1358] 10.222.0.47 () {54 vars in 961 bytes} [Thu Jun 30 13:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:44.142416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4049c-e92a-4ec5-b98d-b5fc0ccfd98b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:44.143219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4049c-e92a-4ec5-b98d-b5fc0ccfd98b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:44.143664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4049c-e92a-4ec5-b98d-b5fc0ccfd98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:44.189090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:44.198045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-abf4049c-e92a-4ec5-b98d-b5fc0ccfd98b None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:44.199237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-abf4049c-e92a-4ec5-b98d-b5fc0ccfd98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:44.286424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 684/1359] 10.222.0.47 () {58 vars in 1058 bytes} [Thu Jun 30 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:11:44.294883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2944bff-a1fe-475e-b4c0-9bb4ca848ccb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:44.309834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2944bff-a1fe-475e-b4c0-9bb4ca848ccb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:44.315325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471dd03-9265-4a38-8412-d28f097bb635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:44.316058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471dd03-9265-4a38-8412-d28f097bb635 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:44.316562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471dd03-9265-4a38-8412-d28f097bb635 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:44.316906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471dd03-9265-4a38-8412-d28f097bb635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:44.325487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471dd03-9265-4a38-8412-d28f097bb635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:44.327141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471dd03-9265-4a38-8412-d28f097bb635 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:44.337297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 676/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:46.564413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2a4e-4976-4e70-9a59-06d1eb920b54 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:46.564962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2a4e-4976-4e70-9a59-06d1eb920b54 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:46.564962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2a4e-4976-4e70-9a59-06d1eb920b54 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:46.566513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 685/1361] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:46.571528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aba795-7403-4735-84ba-05505326a999 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:46.571932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aba795-7403-4735-84ba-05505326a999 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:46.572612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aba795-7403-4735-84ba-05505326a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:46.591852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-65aba795-7403-4735-84ba-05505326a999 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:46.593040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-65aba795-7403-4735-84ba-05505326a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:46.601211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 677/1362] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:11:46.645224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2a4e-4976-4e70-9a59-06d1eb920b54 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:46.660280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2a4e-4976-4e70-9a59-06d1eb920b54 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:46.665779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1da43-c0de-4a9d-9934-4c88810a8d51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:46.666438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1da43-c0de-4a9d-9934-4c88810a8d51 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:46.666727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1da43-c0de-4a9d-9934-4c88810a8d51 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:46.667006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1da43-c0de-4a9d-9934-4c88810a8d51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:46.675410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1da43-c0de-4a9d-9934-4c88810a8d51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:46.676989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1da43-c0de-4a9d-9934-4c88810a8d51 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:46.686681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 686/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:49.035055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d3798-12d4-4ea8-8b3a-67b17f2462cc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:49.035544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d3798-12d4-4ea8-8b3a-67b17f2462cc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:49.035635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d3798-12d4-4ea8-8b3a-67b17f2462cc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:49.036973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 678/1364] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:49.042716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffa005-7ea2-45bc-82a0-b29b0b5d1fd1 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:49.043542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffa005-7ea2-45bc-82a0-b29b0b5d1fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:49.044029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffa005-7ea2-45bc-82a0-b29b0b5d1fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:49.068251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d2ffa005-7ea2-45bc-82a0-b29b0b5d1fd1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:49.069845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d2ffa005-7ea2-45bc-82a0-b29b0b5d1fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:49.085981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 687/1365] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:49.124936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec0fb9-fe56-4108-acc8-76e1330df817 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:49.125221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec0fb9-fe56-4108-acc8-76e1330df817 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:49.125519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec0fb9-fe56-4108-acc8-76e1330df817 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:49.127026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 679/1366] 10.222.0.47 () {54 vars in 961 bytes} [Thu Jun 30 13:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:49.132135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ffb4d-11d1-4f49-9677-3d1ab0b98992 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:49.132422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ffb4d-11d1-4f49-9677-3d1ab0b98992 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:49.132696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ffb4d-11d1-4f49-9677-3d1ab0b98992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:49.151184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f96ffb4d-11d1-4f49-9677-3d1ab0b98992 None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:49.152363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f96ffb4d-11d1-4f49-9677-3d1ab0b98992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:49.161702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 688/1367] 10.222.0.47 () {58 vars in 1058 bytes} [Thu Jun 30 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:11:49.169959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec0fb9-fe56-4108-acc8-76e1330df817 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:49.185126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec0fb9-fe56-4108-acc8-76e1330df817 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:49.190632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9915-4d99-4171-970c-8534c8b98de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:49.191346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9915-4d99-4171-970c-8534c8b98de9 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:49.191723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9915-4d99-4171-970c-8534c8b98de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:49.192068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9915-4d99-4171-970c-8534c8b98de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:49.200397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9915-4d99-4171-970c-8534c8b98de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:49.201995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9915-4d99-4171-970c-8534c8b98de9 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:49.211581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 680/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:51.320840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e959b75-3ac2-4c7a-9e9c-11404d158e65 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:51.321427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e959b75-3ac2-4c7a-9e9c-11404d158e65 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:51.321427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e959b75-3ac2-4c7a-9e9c-11404d158e65 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:51.323345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 689/1369] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:51.328618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b606f3-1085-4ff0-9889-e32be1a0b9d7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:51.329075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b606f3-1085-4ff0-9889-e32be1a0b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:51.329167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b606f3-1085-4ff0-9889-e32be1a0b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:51.347328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-94b606f3-1085-4ff0-9889-e32be1a0b9d7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:51.348516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-94b606f3-1085-4ff0-9889-e32be1a0b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:51.358074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 681/1370] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:51.403877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e959b75-3ac2-4c7a-9e9c-11404d158e65 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:51.418160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e959b75-3ac2-4c7a-9e9c-11404d158e65 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:51.423521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086859-1280-4642-b17c-5b4563f193b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:51.424157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086859-1280-4642-b17c-5b4563f193b3 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:51.424438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086859-1280-4642-b17c-5b4563f193b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:51.424712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086859-1280-4642-b17c-5b4563f193b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:51.433687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086859-1280-4642-b17c-5b4563f193b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:51.435263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086859-1280-4642-b17c-5b4563f193b3 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:51.445327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 690/1371] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:52.096994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08564e2-3c10-4a5c-87b3-f78e3b035827 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:52.097370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08564e2-3c10-4a5c-87b3-f78e3b035827 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:52.097950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08564e2-3c10-4a5c-87b3-f78e3b035827 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:52.099565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 682/1372] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:52.105276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c4ab-e028-4101-a62c-7180d66c169d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:52.105604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c4ab-e028-4101-a62c-7180d66c169d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:52.105892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c4ab-e028-4101-a62c-7180d66c169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:52.126596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-37f7c4ab-e028-4101-a62c-7180d66c169d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:52.127814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-37f7c4ab-e028-4101-a62c-7180d66c169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:52.136210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 691/1373] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:52.494307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76477b60-e011-4b39-973f-9dfd47ae2000 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:52.494795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76477b60-e011-4b39-973f-9dfd47ae2000 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:52.495091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76477b60-e011-4b39-973f-9dfd47ae2000 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:52.497132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 683/1374] 10.222.0.47 () {54 vars in 963 bytes} [Thu Jun 30 13:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:52.502134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d7122-9062-4c5f-9638-d20e23b9394a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:52.502576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d7122-9062-4c5f-9638-d20e23b9394a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:52.502904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d7122-9062-4c5f-9638-d20e23b9394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:52.553987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7f1d7122-9062-4c5f-9638-d20e23b9394a None None] MFA Rules not processed for user `71a850623f9b43f580dcdc7380ca9ede`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:52.555344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7f1d7122-9062-4c5f-9638-d20e23b9394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:52.622736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 692/1375] 10.222.0.47 () {58 vars in 1060 bytes} [Thu Jun 30 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:52.630766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76477b60-e011-4b39-973f-9dfd47ae2000 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:52.646051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76477b60-e011-4b39-973f-9dfd47ae2000 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:52.649828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6199bfc-4ac8-4e90-9edc-a6a7ec498ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:52.651132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199bfc-4ac8-4e90-9edc-a6a7ec498ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:52.651515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199bfc-4ac8-4e90-9edc-a6a7ec498ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:52.652008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199bfc-4ac8-4e90-9edc-a6a7ec498ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:52.662070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6199bfc-4ac8-4e90-9edc-a6a7ec498ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:52.663632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6199bfc-4ac8-4e90-9edc-a6a7ec498ac5 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:52.674992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 684/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:53.527416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3bc55-6169-4940-a0e1-3511bfbeaf51 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:53.528333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3bc55-6169-4940-a0e1-3511bfbeaf51 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:53.528621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3bc55-6169-4940-a0e1-3511bfbeaf51 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:53.530042 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 693/1377] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:53.535217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df42b-6d4c-4d01-aa31-abbc998df571 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:53.535649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df42b-6d4c-4d01-aa31-abbc998df571 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:53.535806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df42b-6d4c-4d01-aa31-abbc998df571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:53.554182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-454df42b-6d4c-4d01-aa31-abbc998df571 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:53.555388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-454df42b-6d4c-4d01-aa31-abbc998df571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:53.563293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 685/1378] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:53.608913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3bc55-6169-4940-a0e1-3511bfbeaf51 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:53.623261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3bc55-6169-4940-a0e1-3511bfbeaf51 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:53.628726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883784a-8759-4ce3-9ad6-6dda475c7946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:53.629362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883784a-8759-4ce3-9ad6-6dda475c7946 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:53.629686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883784a-8759-4ce3-9ad6-6dda475c7946 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:53.629968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883784a-8759-4ce3-9ad6-6dda475c7946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:53.638025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883784a-8759-4ce3-9ad6-6dda475c7946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:53.639600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883784a-8759-4ce3-9ad6-6dda475c7946 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:53.647633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:53.649774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 694/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:55.708600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5fc8-a5d5-4ab6-8c1f-27bf7e05caa0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:55.709091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5fc8-a5d5-4ab6-8c1f-27bf7e05caa0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:55.709091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5fc8-a5d5-4ab6-8c1f-27bf7e05caa0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:55.710458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 686/1380] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:55.715940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14d11-8ef3-4782-89fc-764df2a0fe96 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:55.716340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14d11-8ef3-4782-89fc-764df2a0fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:55.716492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14d11-8ef3-4782-89fc-764df2a0fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:55.734619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d4c14d11-8ef3-4782-89fc-764df2a0fe96 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:55.735802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d4c14d11-8ef3-4782-89fc-764df2a0fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:55.743539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 695/1381] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:55.788322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5fc8-a5d5-4ab6-8c1f-27bf7e05caa0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:55.803730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5fc8-a5d5-4ab6-8c1f-27bf7e05caa0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:55.809367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13c295-474b-4709-8b32-1749c96d98a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:55.810033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13c295-474b-4709-8b32-1749c96d98a1 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:55.810313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13c295-474b-4709-8b32-1749c96d98a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:55.810586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13c295-474b-4709-8b32-1749c96d98a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:55.818712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13c295-474b-4709-8b32-1749c96d98a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:55.820296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13c295-474b-4709-8b32-1749c96d98a1 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:55.829980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 687/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:11:57.897004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155490d-115c-439d-8de5-10aa5628dbea None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:57.897544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155490d-115c-439d-8de5-10aa5628dbea None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:57.897664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155490d-115c-439d-8de5-10aa5628dbea None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:57.899062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 696/1383] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:11:57.904741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b472c1-bd23-4ce1-9435-be00b2c29517 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:57.905187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b472c1-bd23-4ce1-9435-be00b2c29517 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:57.905285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b472c1-bd23-4ce1-9435-be00b2c29517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:57.923102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-76b472c1-bd23-4ce1-9435-be00b2c29517 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:11:57.924290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-76b472c1-bd23-4ce1-9435-be00b2c29517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:57.932334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 688/1384] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:11:57.974456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155490d-115c-439d-8de5-10aa5628dbea None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:57.989490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155490d-115c-439d-8de5-10aa5628dbea None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:57.995638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8757-50fc-47ac-ab69-d79550e00888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:57.996262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8757-50fc-47ac-ab69-d79550e00888 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:57.996545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8757-50fc-47ac-ab69-d79550e00888 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:57.996820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8757-50fc-47ac-ab69-d79550e00888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:58.005872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8757-50fc-47ac-ab69-d79550e00888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:58.007441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8757-50fc-47ac-ab69-d79550e00888 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:58.018268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 697/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:00.045542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc83ae8-1f13-42e2-9b19-b42f3fc5d1b1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:00.046202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc83ae8-1f13-42e2-9b19-b42f3fc5d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:00.046202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc83ae8-1f13-42e2-9b19-b42f3fc5d1b1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:00.052636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090a08-eafd-4ca7-ac88-eedd3c202551 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:00.053481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090a08-eafd-4ca7-ac88-eedd3c202551 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:00.053481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090a08-eafd-4ca7-ac88-eedd3c202551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:00.055302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 689/1386] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:12:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:00.071921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-bc090a08-eafd-4ca7-ac88-eedd3c202551 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:00.073546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bc090a08-eafd-4ca7-ac88-eedd3c202551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:00.084033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 698/1387] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:12:00.128799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc83ae8-1f13-42e2-9b19-b42f3fc5d1b1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:00.143523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc83ae8-1f13-42e2-9b19-b42f3fc5d1b1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:00.149908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e17ce7-82dd-4db4-9cdf-1fbcece0293e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:00.150516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17ce7-82dd-4db4-9cdf-1fbcece0293e service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:00.150798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17ce7-82dd-4db4-9cdf-1fbcece0293e service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:00.151072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17ce7-82dd-4db4-9cdf-1fbcece0293e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:00.159696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e17ce7-82dd-4db4-9cdf-1fbcece0293e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:00.161046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e17ce7-82dd-4db4-9cdf-1fbcece0293e service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:00.171641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 690/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:02.248460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f9ba-c8f2-4460-a0fb-d53337b86e84 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:02.249095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f9ba-c8f2-4460-a0fb-d53337b86e84 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:02.249095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f9ba-c8f2-4460-a0fb-d53337b86e84 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:02.250404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 699/1389] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:02.255588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895cac-336f-4bfa-88ee-aafc771a0988 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:02.256065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895cac-336f-4bfa-88ee-aafc771a0988 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:02.256228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895cac-336f-4bfa-88ee-aafc771a0988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:02.275687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b3895cac-336f-4bfa-88ee-aafc771a0988 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:02.276756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b3895cac-336f-4bfa-88ee-aafc771a0988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:02.284879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 691/1390] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:02.328501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f9ba-c8f2-4460-a0fb-d53337b86e84 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:02.343785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f9ba-c8f2-4460-a0fb-d53337b86e84 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:02.349819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090c993-fae0-49ce-9233-11c14b84a1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:02.350851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090c993-fae0-49ce-9233-11c14b84a1cf service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:02.351455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090c993-fae0-49ce-9233-11c14b84a1cf service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:02.351806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090c993-fae0-49ce-9233-11c14b84a1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:02.362914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090c993-fae0-49ce-9233-11c14b84a1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:02.364933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090c993-fae0-49ce-9233-11c14b84a1cf service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:02.376798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 700/1391] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:04.442764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4e94-d0a9-484a-a754-3cd27cc8cfea None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:04.443318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4e94-d0a9-484a-a754-3cd27cc8cfea None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:04.443415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4e94-d0a9-484a-a754-3cd27cc8cfea None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:04.445278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 692/1392] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:04.451389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6d4d9-1296-4a11-af16-642bcc3290f4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:04.451970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6d4d9-1296-4a11-af16-642bcc3290f4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:04.452068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6d4d9-1296-4a11-af16-642bcc3290f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:04.476848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-91b6d4d9-1296-4a11-af16-642bcc3290f4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:04.478422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-91b6d4d9-1296-4a11-af16-642bcc3290f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:04.489024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 701/1393] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:04.536277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4e94-d0a9-484a-a754-3cd27cc8cfea None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:04.551057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4e94-d0a9-484a-a754-3cd27cc8cfea None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:04.556992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc94f7-737b-4478-ba6d-d87d317f7808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:04.557682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc94f7-737b-4478-ba6d-d87d317f7808 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:04.557975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc94f7-737b-4478-ba6d-d87d317f7808 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:04.558264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc94f7-737b-4478-ba6d-d87d317f7808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:04.569066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc94f7-737b-4478-ba6d-d87d317f7808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:04.571155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc94f7-737b-4478-ba6d-d87d317f7808 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:04.584490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 693/1394] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:06.665441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37ae3-f51d-4c62-bba3-6fd89aed38dd None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:06.666536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37ae3-f51d-4c62-bba3-6fd89aed38dd None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:06.666536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37ae3-f51d-4c62-bba3-6fd89aed38dd None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:06.668094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 702/1395] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:06.673047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d787b-1c7d-4d6a-8c42-cd1f666dce96 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:06.673492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d787b-1c7d-4d6a-8c42-cd1f666dce96 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:06.673645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d787b-1c7d-4d6a-8c42-cd1f666dce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:06.691693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-553d787b-1c7d-4d6a-8c42-cd1f666dce96 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:06.692867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-553d787b-1c7d-4d6a-8c42-cd1f666dce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:06.700869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 694/1396] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:12:06.744934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca37ae3-f51d-4c62-bba3-6fd89aed38dd None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:06.758967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca37ae3-f51d-4c62-bba3-6fd89aed38dd None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:06.764240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8015e-0f0a-4610-8b1a-4604c7312f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:06.764867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8015e-0f0a-4610-8b1a-4604c7312f21 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:06.765148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8015e-0f0a-4610-8b1a-4604c7312f21 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:06.765421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8015e-0f0a-4610-8b1a-4604c7312f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:06.773430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8015e-0f0a-4610-8b1a-4604c7312f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:06.775034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8015e-0f0a-4610-8b1a-4604c7312f21 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:06.784197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 703/1397] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:07.825546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff85feb-fefe-40bf-a170-6cb945d554d3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:07.826089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff85feb-fefe-40bf-a170-6cb945d554d3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:07.826179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff85feb-fefe-40bf-a170-6cb945d554d3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:07.827477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 695/1398] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:07.832682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4493f-a17f-4d26-bdcc-15d68f3ad60b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:07.833094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4493f-a17f-4d26-bdcc-15d68f3ad60b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:07.833237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4493f-a17f-4d26-bdcc-15d68f3ad60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:07.850700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4bd4493f-a17f-4d26-bdcc-15d68f3ad60b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:07.851871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4bd4493f-a17f-4d26-bdcc-15d68f3ad60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:07.860202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 704/1399] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:07.916290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48ad19-b7d0-4afc-b00a-028dd3536f1d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:07.916575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48ad19-b7d0-4afc-b00a-028dd3536f1d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:07.916851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48ad19-b7d0-4afc-b00a-028dd3536f1d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:07.918262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 696/1400] 10.222.0.47 () {54 vars in 962 bytes} [Thu Jun 30 13:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:07.923466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461ac43-ce25-4c0d-a00b-a67e472a9e96 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:07.923764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461ac43-ce25-4c0d-a00b-a67e472a9e96 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:07.924082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461ac43-ce25-4c0d-a00b-a67e472a9e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:07.972223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2461ac43-ce25-4c0d-a00b-a67e472a9e96 None None] MFA Rules not processed for user `ca9f55fa22844a31ba5bc9bff04ab67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:07.973408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2461ac43-ce25-4c0d-a00b-a67e472a9e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:08.032447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 705/1401] 10.222.0.47 () {58 vars in 1059 bytes} [Thu Jun 30 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:08.039978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48ad19-b7d0-4afc-b00a-028dd3536f1d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:08.050357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48ad19-b7d0-4afc-b00a-028dd3536f1d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:08.053820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b0c74-d638-477f-a43a-030d91d63e96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca9f55fa22844a31ba5bc9bff04ab67d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:08.054450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0c74-d638-477f-a43a-030d91d63e96 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:08.054735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0c74-d638-477f-a43a-030d91d63e96 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:08.055014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0c74-d638-477f-a43a-030d91d63e96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:08.064175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b0c74-d638-477f-a43a-030d91d63e96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:08.065612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b0c74-d638-477f-a43a-030d91d63e96 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:08.075645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 697/1402] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:08.786812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b14a-2ee3-4358-a96a-b7d4f73f2373 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:08.787181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b14a-2ee3-4358-a96a-b7d4f73f2373 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:08.787535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b14a-2ee3-4358-a96a-b7d4f73f2373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:08.837831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2fe5b14a-2ee3-4358-a96a-b7d4f73f2373 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:08.839739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2fe5b14a-2ee3-4358-a96a-b7d4f73f2373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:08.842393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce64e06-5604-462b-9afa-ddff112b9696 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:08.842805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce64e06-5604-462b-9afa-ddff112b9696 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:08.842994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce64e06-5604-462b-9afa-ddff112b9696 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:08.844470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 698/1403] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:08.849167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35af2e-9ade-4f92-9884-c748d0510ff6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:08.849492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35af2e-9ade-4f92-9884-c748d0510ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:08.849775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35af2e-9ade-4f92-9884-c748d0510ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:08.868099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2b35af2e-9ade-4f92-9884-c748d0510ff6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:08.869342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b35af2e-9ade-4f92-9884-c748d0510ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:08.878084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 699/1404] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:08.885658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:08.910864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 706/1405] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:08.924903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35af2e-9ade-4f92-9884-c748d0510ff6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:08.938384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35af2e-9ade-4f92-9884-c748d0510ff6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:08.944444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:08.945125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:08.945409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:08.945721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:08.952070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac482168-60d3-4277-af44-ff118408e440 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:08.952370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac482168-60d3-4277-af44-ff118408e440 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:08.952652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac482168-60d3-4277-af44-ff118408e440 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:08.954070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 707/1406] 10.222.0.47 () {54 vars in 942 bytes} [Thu Jun 30 13:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:12:08.955363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:08.957004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:08.960237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d889-43bf-4526-8989-f902eeb4ea7c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:08.960605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d889-43bf-4526-8989-f902eeb4ea7c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:08.960949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d889-43bf-4526-8989-f902eeb4ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:08.967743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 700/1407] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:09.011641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-64e8d889-43bf-4526-8989-f902eeb4ea7c None None] MFA Rules not processed for user `2ecb9bd88bce4c4c8014471d79105772`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:09.012878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-64e8d889-43bf-4526-8989-f902eeb4ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:09.090475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 708/1408] 10.222.0.47 () {58 vars in 1039 bytes} [Thu Jun 30 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:12:09.100323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:09.111704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8a0db-7aee-48b9-bcbe-2c64ab330b43 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:09.117901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b3c8-ef02-4c99-90c8-f6ece230c5dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:09.118802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b3c8-ef02-4c99-90c8-f6ece230c5dc service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:09.119718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b3c8-ef02-4c99-90c8-f6ece230c5dc service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:09.119718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b3c8-ef02-4c99-90c8-f6ece230c5dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:09.128818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b3c8-ef02-4c99-90c8-f6ece230c5dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:09.130503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b3c8-ef02-4c99-90c8-f6ece230c5dc service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:09.140296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 701/1409] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:12:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:12:19.086606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=53 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:19.136360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=75 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:31.434268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ccb6-125c-4c5a-bd03-487368cb49bc None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:31.434860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ccb6-125c-4c5a-bd03-487368cb49bc None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:31.434860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ccb6-125c-4c5a-bd03-487368cb49bc None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:31.436113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 709/1410] 10.222.0.47 () {54 vars in 918 bytes} [Thu Jun 30 13:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:31.441073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75703-b7b0-4bc8-a511-96a4486ae595 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:31.441566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75703-b7b0-4bc8-a511-96a4486ae595 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:31.441754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75703-b7b0-4bc8-a511-96a4486ae595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:31.459531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b6e75703-b7b0-4bc8-a511-96a4486ae595 None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:31.460705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b6e75703-b7b0-4bc8-a511-96a4486ae595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:31.469941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 702/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 30 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:31.483972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a232-a700-4648-974e-a1f62a56ab33 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:31.484263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a232-a700-4648-974e-a1f62a56ab33 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:31.484537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a232-a700-4648-974e-a1f62a56ab33 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:31.485964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 710/1412] 10.222.0.47 () {54 vars in 918 bytes} [Thu Jun 30 13:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:31.490365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc88ef6-8297-49cb-938d-6297663fac75 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:31.490657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc88ef6-8297-49cb-938d-6297663fac75 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:31.490969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc88ef6-8297-49cb-938d-6297663fac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:31.508141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0cc88ef6-8297-49cb-938d-6297663fac75 None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:31.509846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0cc88ef6-8297-49cb-938d-6297663fac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:31.518981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 703/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 30 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:12:33.983706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014d7b7-dc0b-4880-9587-b5739e48f165 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:33.984247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014d7b7-dc0b-4880-9587-b5739e48f165 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:33.984247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014d7b7-dc0b-4880-9587-b5739e48f165 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:33.985672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:33.990924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a316-a4e6-40c4-acd1-e5eb34a75b6b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:33.991315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a316-a4e6-40c4-acd1-e5eb34a75b6b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:33.991508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a316-a4e6-40c4-acd1-e5eb34a75b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:34.010094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4855a316-a4e6-40c4-acd1-e5eb34a75b6b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:34.011371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4855a316-a4e6-40c4-acd1-e5eb34a75b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:34.019350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:34.062543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014d7b7-dc0b-4880-9587-b5739e48f165 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:34.077325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014d7b7-dc0b-4880-9587-b5739e48f165 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:34.082691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9aeae-fe15-4678-bf2d-104ca4a20788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:34.083324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9aeae-fe15-4678-bf2d-104ca4a20788 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:34.083612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9aeae-fe15-4678-bf2d-104ca4a20788 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:34.083888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9aeae-fe15-4678-bf2d-104ca4a20788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:34.092109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9aeae-fe15-4678-bf2d-104ca4a20788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:34.093741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9aeae-fe15-4678-bf2d-104ca4a20788 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:34.102931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 712/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:34.993937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687529-34e3-4578-8b62-b146bf2d3660 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:34.994500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687529-34e3-4578-8b62-b146bf2d3660 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:34.994500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687529-34e3-4578-8b62-b146bf2d3660 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:34.995842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:35.000657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b521-869d-4ee1-9cdd-7a366ce76cc6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:35.001102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b521-869d-4ee1-9cdd-7a366ce76cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:35.001221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b521-869d-4ee1-9cdd-7a366ce76cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:35.018815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-05e9b521-869d-4ee1-9cdd-7a366ce76cc6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:35.020002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-05e9b521-869d-4ee1-9cdd-7a366ce76cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:35.028151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:12:35.178466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13687529-34e3-4578-8b62-b146bf2d3660 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:35.192592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13687529-34e3-4578-8b62-b146bf2d3660 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:35.198449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9334103-5b4d-4228-830b-3a051864ba9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:35.199076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334103-5b4d-4228-830b-3a051864ba9b service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:35.199364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334103-5b4d-4228-830b-3a051864ba9b service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:35.199636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334103-5b4d-4228-830b-3a051864ba9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:35.207693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9334103-5b4d-4228-830b-3a051864ba9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:35.209264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9334103-5b4d-4228-830b-3a051864ba9b service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:35.219977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 706/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:36.088082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eece2d-b859-41cc-8526-775891aa5805 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:36.088611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eece2d-b859-41cc-8526-775891aa5805 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:36.088611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eece2d-b859-41cc-8526-775891aa5805 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:36.089960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:36.094730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14669f-7136-4dc0-9990-514905c50da7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:36.095159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14669f-7136-4dc0-9990-514905c50da7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:36.095289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14669f-7136-4dc0-9990-514905c50da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:36.112755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8a14669f-7136-4dc0-9990-514905c50da7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:36.113954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8a14669f-7136-4dc0-9990-514905c50da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:36.122244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:36.272216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eece2d-b859-41cc-8526-775891aa5805 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:36.286951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eece2d-b859-41cc-8526-775891aa5805 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:36.292822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f180d-30b1-49f1-ac83-c4c7b1f48285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:36.293446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f180d-30b1-49f1-ac83-c4c7b1f48285 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:36.293757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f180d-30b1-49f1-ac83-c4c7b1f48285 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:36.294035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f180d-30b1-49f1-ac83-c4c7b1f48285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:36.301987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f180d-30b1-49f1-ac83-c4c7b1f48285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:36.303551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f180d-30b1-49f1-ac83-c4c7b1f48285 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:36.312784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 715/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:37.166944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb812f7-730c-4a58-bcd4-e9b4c6a3f60c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:37.167396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb812f7-730c-4a58-bcd4-e9b4c6a3f60c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:37.167506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb812f7-730c-4a58-bcd4-e9b4c6a3f60c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:37.168861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:37.173898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6758-3e02-4aba-8976-f9edabb12086 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:37.174328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6758-3e02-4aba-8976-f9edabb12086 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:37.174488 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6758-3e02-4aba-8976-f9edabb12086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:37.192508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0e9a6758-3e02-4aba-8976-f9edabb12086 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:37.193715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0e9a6758-3e02-4aba-8976-f9edabb12086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:37.201948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:37.351423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb812f7-730c-4a58-bcd4-e9b4c6a3f60c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:37.366402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb812f7-730c-4a58-bcd4-e9b4c6a3f60c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:37.371832 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d419b-2dbe-4c24-a676-dc49ad6cecbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:37.372465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d419b-2dbe-4c24-a676-dc49ad6cecbe service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:37.372752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d419b-2dbe-4c24-a676-dc49ad6cecbe service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:37.373030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d419b-2dbe-4c24-a676-dc49ad6cecbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:37.380981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d419b-2dbe-4c24-a676-dc49ad6cecbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:37.382609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d419b-2dbe-4c24-a676-dc49ad6cecbe service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:37.392324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 709/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:38.250249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703946-53b3-48f0-b986-329f2f4f6b46 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:38.250823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703946-53b3-48f0-b986-329f2f4f6b46 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:38.250823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703946-53b3-48f0-b986-329f2f4f6b46 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:38.252190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:38.256926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135907d5-2af1-4b9e-a3de-972126cc9fa8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:38.257371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135907d5-2af1-4b9e-a3de-972126cc9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:38.257506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135907d5-2af1-4b9e-a3de-972126cc9fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:38.275784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-135907d5-2af1-4b9e-a3de-972126cc9fa8 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:38.276980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-135907d5-2af1-4b9e-a3de-972126cc9fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:38.284721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:38.433850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703946-53b3-48f0-b986-329f2f4f6b46 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:38.448411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703946-53b3-48f0-b986-329f2f4f6b46 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:38.453665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4b7e1-7e3d-4b59-89e9-91a80943ce3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:38.454296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b7e1-7e3d-4b59-89e9-91a80943ce3c service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:38.454574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b7e1-7e3d-4b59-89e9-91a80943ce3c service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:38.454844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b7e1-7e3d-4b59-89e9-91a80943ce3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:38.463600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4b7e1-7e3d-4b59-89e9-91a80943ce3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:38.465162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4b7e1-7e3d-4b59-89e9-91a80943ce3c service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:38.474308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 718/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:39.270701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bb9d9-49a0-47f4-a83c-4103211b7e4a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:39.271270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bb9d9-49a0-47f4-a83c-4103211b7e4a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:39.271270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bb9d9-49a0-47f4-a83c-4103211b7e4a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:39.272621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:39.277903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ecc69-9252-4c35-8e50-0818ab0c972e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:39.278348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ecc69-9252-4c35-8e50-0818ab0c972e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:39.278456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ecc69-9252-4c35-8e50-0818ab0c972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:39.296805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-fb6ecc69-9252-4c35-8e50-0818ab0c972e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:39.298034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fb6ecc69-9252-4c35-8e50-0818ab0c972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:39.306233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:39.455391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bb9d9-49a0-47f4-a83c-4103211b7e4a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:39.469870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bb9d9-49a0-47f4-a83c-4103211b7e4a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:39.475201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5592-83ce-4753-8d6f-52391445f6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:39.475830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5592-83ce-4753-8d6f-52391445f6bf service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:39.476114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5592-83ce-4753-8d6f-52391445f6bf service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:39.476389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5592-83ce-4753-8d6f-52391445f6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:39.484422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5592-83ce-4753-8d6f-52391445f6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:39.486021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5592-83ce-4753-8d6f-52391445f6bf service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:39.495889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 712/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:40.295958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e002f-802a-4a60-8ce6-01e5834e415c None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:40.296546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e002f-802a-4a60-8ce6-01e5834e415c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:40.296546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e002f-802a-4a60-8ce6-01e5834e415c None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:40.297959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:40.302764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7134f00-8501-42ad-8d67-fde713e6e432 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:40.303208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7134f00-8501-42ad-8d67-fde713e6e432 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:40.303303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7134f00-8501-42ad-8d67-fde713e6e432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:40.321835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b7134f00-8501-42ad-8d67-fde713e6e432 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:40.323005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b7134f00-8501-42ad-8d67-fde713e6e432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:40.330587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:40.480934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e002f-802a-4a60-8ce6-01e5834e415c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:40.495742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e002f-802a-4a60-8ce6-01e5834e415c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:40.501052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb34b32-8dbe-4114-ba54-9baff84851fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:40.501719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb34b32-8dbe-4114-ba54-9baff84851fb service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:40.502005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb34b32-8dbe-4114-ba54-9baff84851fb service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:40.502282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb34b32-8dbe-4114-ba54-9baff84851fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:40.510346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb34b32-8dbe-4114-ba54-9baff84851fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:40.511903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb34b32-8dbe-4114-ba54-9baff84851fb service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:40.521317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 721/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:41.341126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612025b-f1fe-46f4-99cd-f2373d686368 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:41.341681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612025b-f1fe-46f4-99cd-f2373d686368 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:41.341764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612025b-f1fe-46f4-99cd-f2373d686368 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:41.343081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:41.348013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff45b9-6d7c-499d-ac6d-c94ed540b17e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:41.348630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff45b9-6d7c-499d-ac6d-c94ed540b17e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:41.348630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff45b9-6d7c-499d-ac6d-c94ed540b17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:41.368233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-fbff45b9-6d7c-499d-ac6d-c94ed540b17e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:41.369452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fbff45b9-6d7c-499d-ac6d-c94ed540b17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:41.377447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:41.534176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612025b-f1fe-46f4-99cd-f2373d686368 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:41.548321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612025b-f1fe-46f4-99cd-f2373d686368 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:41.553819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba330454-e34a-41ca-8611-343c54e82412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:41.554452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba330454-e34a-41ca-8611-343c54e82412 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:41.554738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba330454-e34a-41ca-8611-343c54e82412 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:41.555017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba330454-e34a-41ca-8611-343c54e82412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:41.563635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba330454-e34a-41ca-8611-343c54e82412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:41.565206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba330454-e34a-41ca-8611-343c54e82412 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:41.575087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 715/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:42.371063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a5b3d-21f6-4e60-b31f-c0736d86b553 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:42.371523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a5b3d-21f6-4e60-b31f-c0736d86b553 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:42.371617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a5b3d-21f6-4e60-b31f-c0736d86b553 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:42.373027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:42.377903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba56a09-5552-401c-a7da-c3f2c3a84c87 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:42.378350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba56a09-5552-401c-a7da-c3f2c3a84c87 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:42.378447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba56a09-5552-401c-a7da-c3f2c3a84c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:42.396726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1ba56a09-5552-401c-a7da-c3f2c3a84c87 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:42.397965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1ba56a09-5552-401c-a7da-c3f2c3a84c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:42.405831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:42.557113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a5b3d-21f6-4e60-b31f-c0736d86b553 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:42.571798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a5b3d-21f6-4e60-b31f-c0736d86b553 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:42.577170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd94e3-1473-4a5d-99d5-6243aa1ee17f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:42.577840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd94e3-1473-4a5d-99d5-6243aa1ee17f service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:42.578125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd94e3-1473-4a5d-99d5-6243aa1ee17f service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:42.578403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd94e3-1473-4a5d-99d5-6243aa1ee17f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:42.586330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd94e3-1473-4a5d-99d5-6243aa1ee17f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:42.588667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd94e3-1473-4a5d-99d5-6243aa1ee17f service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:42.598056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 724/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:44.534290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff601-7e6c-4307-ba16-f577e68289fb None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:44.534833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff601-7e6c-4307-ba16-f577e68289fb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:44.534833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff601-7e6c-4307-ba16-f577e68289fb None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:44.536214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:44.541481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcf5a-8988-4525-aff6-3bb7f66834c7 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:44.541938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcf5a-8988-4525-aff6-3bb7f66834c7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:44.542036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcf5a-8988-4525-aff6-3bb7f66834c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:44.559703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c5adcf5a-8988-4525-aff6-3bb7f66834c7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:44.560876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c5adcf5a-8988-4525-aff6-3bb7f66834c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:44.568517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:44.608530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff601-7e6c-4307-ba16-f577e68289fb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:44.620139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff601-7e6c-4307-ba16-f577e68289fb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:44.623603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd322b-98c1-4be1-842e-84acc8d74e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:44.624232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd322b-98c1-4be1-842e-84acc8d74e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:44.624515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd322b-98c1-4be1-842e-84acc8d74e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:44.624791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd322b-98c1-4be1-842e-84acc8d74e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:44.633535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd322b-98c1-4be1-842e-84acc8d74e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:44.634947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd322b-98c1-4be1-842e-84acc8d74e53 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:44.644263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 718/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:46.819733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fb4e3-3d44-4b09-914f-cf71fb614818 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:46.820316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fb4e3-3d44-4b09-914f-cf71fb614818 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:46.820316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fb4e3-3d44-4b09-914f-cf71fb614818 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:46.821705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:46.826898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8a02-4af1-4ec3-af9b-d07a2b1a10bf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:46.827358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8a02-4af1-4ec3-af9b-d07a2b1a10bf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:46.827458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8a02-4af1-4ec3-af9b-d07a2b1a10bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:46.845509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-930f8a02-4af1-4ec3-af9b-d07a2b1a10bf None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:46.846695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-930f8a02-4af1-4ec3-af9b-d07a2b1a10bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:46.854916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:46.891650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fb4e3-3d44-4b09-914f-cf71fb614818 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:46.902640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fb4e3-3d44-4b09-914f-cf71fb614818 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:46.906022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be507e-e730-44bf-aaa4-e4bcc2b96644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:46.906646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be507e-e730-44bf-aaa4-e4bcc2b96644 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:46.906931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be507e-e730-44bf-aaa4-e4bcc2b96644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:46.907225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be507e-e730-44bf-aaa4-e4bcc2b96644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:46.916407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be507e-e730-44bf-aaa4-e4bcc2b96644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:46.917851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be507e-e730-44bf-aaa4-e4bcc2b96644 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:46.926920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 727/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:49.311737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19018f30-b797-4808-8b92-a191c96cc6e5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:49.312267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19018f30-b797-4808-8b92-a191c96cc6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:49.312381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19018f30-b797-4808-8b92-a191c96cc6e5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:49.313698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:49.318827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929d53-9880-47f7-a23f-196eded8b142 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:49.319255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929d53-9880-47f7-a23f-196eded8b142 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:49.319424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929d53-9880-47f7-a23f-196eded8b142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:49.337202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7c929d53-9880-47f7-a23f-196eded8b142 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:49.338705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7c929d53-9880-47f7-a23f-196eded8b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:49.346472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:49.385287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19018f30-b797-4808-8b92-a191c96cc6e5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:49.395954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19018f30-b797-4808-8b92-a191c96cc6e5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:49.399990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f427c-2ed0-46a5-b045-3e3d95d98ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:49.400616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f427c-2ed0-46a5-b045-3e3d95d98ced service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:49.400900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f427c-2ed0-46a5-b045-3e3d95d98ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:49.401176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f427c-2ed0-46a5-b045-3e3d95d98ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:49.409988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f427c-2ed0-46a5-b045-3e3d95d98ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:49.411404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f427c-2ed0-46a5-b045-3e3d95d98ced service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:49.420684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 721/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:51.585316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321706-bead-4464-9e8d-992110053756 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:51.585871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321706-bead-4464-9e8d-992110053756 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:51.585977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321706-bead-4464-9e8d-992110053756 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:51.588070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:51.593623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492974b7-9ee6-4d08-9e75-5330159618f1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:51.594060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492974b7-9ee6-4d08-9e75-5330159618f1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:51.594260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492974b7-9ee6-4d08-9e75-5330159618f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:51.614308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-492974b7-9ee6-4d08-9e75-5330159618f1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:51.616396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-492974b7-9ee6-4d08-9e75-5330159618f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:51.625222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:51.664289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321706-bead-4464-9e8d-992110053756 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:51.674993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321706-bead-4464-9e8d-992110053756 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:51.678507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e2a08-7c0b-45e6-b3ba-548d60d57a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:51.679132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e2a08-7c0b-45e6-b3ba-548d60d57a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:51.679412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e2a08-7c0b-45e6-b3ba-548d60d57a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:51.679684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e2a08-7c0b-45e6-b3ba-548d60d57a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:51.688442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e2a08-7c0b-45e6-b3ba-548d60d57a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:51.689887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e2a08-7c0b-45e6-b3ba-548d60d57a1c service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:51.699494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 730/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:12:53.778459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdc81-3c54-4ab4-8d93-3b0523fa75ab None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:53.778991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdc81-3c54-4ab4-8d93-3b0523fa75ab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:53.778991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdc81-3c54-4ab4-8d93-3b0523fa75ab None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:53.780295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:53.785410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098ac7f-ad60-42ff-8f5c-e29aff7bbbd4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:53.785839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098ac7f-ad60-42ff-8f5c-e29aff7bbbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:53.785997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098ac7f-ad60-42ff-8f5c-e29aff7bbbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:53.803783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f098ac7f-ad60-42ff-8f5c-e29aff7bbbd4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:53.804988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f098ac7f-ad60-42ff-8f5c-e29aff7bbbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:53.812652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:12:53.850350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdc81-3c54-4ab4-8d93-3b0523fa75ab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:53.861363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdc81-3c54-4ab4-8d93-3b0523fa75ab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:53.864856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14192edc-8afc-4310-9012-5cab17c50381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:53.865487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192edc-8afc-4310-9012-5cab17c50381 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:53.865782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192edc-8afc-4310-9012-5cab17c50381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:53.866055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192edc-8afc-4310-9012-5cab17c50381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:53.875133 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14192edc-8afc-4310-9012-5cab17c50381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:53.876611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14192edc-8afc-4310-9012-5cab17c50381 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:53.886369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 724/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:55.948904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6531c8-50d8-423f-a205-a63f89c93b3c None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:55.949496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6531c8-50d8-423f-a205-a63f89c93b3c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:55.949496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6531c8-50d8-423f-a205-a63f89c93b3c None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:55.950862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:55.956021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95c4b5-0b90-4832-b547-91d59c85465b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:55.956473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95c4b5-0b90-4832-b547-91d59c85465b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:55.956594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95c4b5-0b90-4832-b547-91d59c85465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:55.974348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-db95c4b5-0b90-4832-b547-91d59c85465b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:55.975539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db95c4b5-0b90-4832-b547-91d59c85465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:55.983310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:12:56.021145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6531c8-50d8-423f-a205-a63f89c93b3c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:56.031989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6531c8-50d8-423f-a205-a63f89c93b3c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:56.035564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c4b28-2155-499d-a6bd-87072ae8ef74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:56.036129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4b28-2155-499d-a6bd-87072ae8ef74 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:56.036408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4b28-2155-499d-a6bd-87072ae8ef74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:56.036677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4b28-2155-499d-a6bd-87072ae8ef74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:56.045299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c4b28-2155-499d-a6bd-87072ae8ef74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:56.046730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c4b28-2155-499d-a6bd-87072ae8ef74 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:56.056402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 733/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:58.147063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38648c5-c379-4df1-a004-29d8f283a978 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:58.147631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38648c5-c379-4df1-a004-29d8f283a978 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:58.147631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38648c5-c379-4df1-a004-29d8f283a978 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:58.149021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:12:58.154220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df379002-0157-48b3-ae9f-299de8ea10c0 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:58.154641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df379002-0157-48b3-ae9f-299de8ea10c0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:58.154776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df379002-0157-48b3-ae9f-299de8ea10c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:58.172982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-df379002-0157-48b3-ae9f-299de8ea10c0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:12:58.174206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-df379002-0157-48b3-ae9f-299de8ea10c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:12:58.182634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:12:58.220346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38648c5-c379-4df1-a004-29d8f283a978 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:12:58.230927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38648c5-c379-4df1-a004-29d8f283a978 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:12:58.234390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88648f3e-4725-40d7-a300-a178c0464619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:12:58.235016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648f3e-4725-40d7-a300-a178c0464619 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:12:58.235299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648f3e-4725-40d7-a300-a178c0464619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:12:58.235576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648f3e-4725-40d7-a300-a178c0464619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:12:58.244903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88648f3e-4725-40d7-a300-a178c0464619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:12:58.246342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88648f3e-4725-40d7-a300-a178c0464619 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:12:58.255605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 727/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:00.302410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c87a-0ec8-4375-b5a0-397f0ae35736 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:00.302987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c87a-0ec8-4375-b5a0-397f0ae35736 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:00.302987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c87a-0ec8-4375-b5a0-397f0ae35736 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:00.304333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:00.309988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2668-bc85-43e4-a4be-ef5656e50716 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:00.310431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2668-bc85-43e4-a4be-ef5656e50716 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:00.310575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2668-bc85-43e4-a4be-ef5656e50716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:00.316749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=79 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:00.329903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3a4c2668-bc85-43e4-a4be-ef5656e50716 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:00.331101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a4c2668-bc85-43e4-a4be-ef5656e50716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:00.339186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:13:00.376361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c87a-0ec8-4375-b5a0-397f0ae35736 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:00.384725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=73 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:00.391047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c87a-0ec8-4375-b5a0-397f0ae35736 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:00.394485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b728f7-9c07-4153-9290-365ec233e09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:00.395121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b728f7-9c07-4153-9290-365ec233e09b service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:00.395399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b728f7-9c07-4153-9290-365ec233e09b service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:00.395673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b728f7-9c07-4153-9290-365ec233e09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:00.404305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b728f7-9c07-4153-9290-365ec233e09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:00.405740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b728f7-9c07-4153-9290-365ec233e09b service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:00.414896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 736/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:02.450256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71f77-b548-4490-ac09-c68bb22ebab3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:02.450807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71f77-b548-4490-ac09-c68bb22ebab3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:02.450920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71f77-b548-4490-ac09-c68bb22ebab3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:02.452202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:02.457441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0da3-8e09-409b-b036-b346209c464e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:02.457862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0da3-8e09-409b-b036-b346209c464e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:02.458040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0da3-8e09-409b-b036-b346209c464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:02.476115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9ace0da3-8e09-409b-b036-b346209c464e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:02.477335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9ace0da3-8e09-409b-b036-b346209c464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:02.484948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:02.521772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca71f77-b548-4490-ac09-c68bb22ebab3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:02.532402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca71f77-b548-4490-ac09-c68bb22ebab3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:02.535912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1e8b5-cd84-44e8-a4db-5244c275e568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:02.536540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1e8b5-cd84-44e8-a4db-5244c275e568 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:02.536826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1e8b5-cd84-44e8-a4db-5244c275e568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:02.537106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1e8b5-cd84-44e8-a4db-5244c275e568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:02.546179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1e8b5-cd84-44e8-a4db-5244c275e568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:02.547585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1e8b5-cd84-44e8-a4db-5244c275e568 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:02.557320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 730/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:04.592398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7821e7-ea03-4546-aed3-c93f9dbaffc1 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:04.592965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7821e7-ea03-4546-aed3-c93f9dbaffc1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:04.592965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7821e7-ea03-4546-aed3-c93f9dbaffc1 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:04.594358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:04.599631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194fd7-05d2-4ef6-9950-0002a03610a0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:04.600046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194fd7-05d2-4ef6-9950-0002a03610a0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:04.600183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194fd7-05d2-4ef6-9950-0002a03610a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:04.617834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b9194fd7-05d2-4ef6-9950-0002a03610a0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:04.618951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b9194fd7-05d2-4ef6-9950-0002a03610a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:04.626594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:04.663338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7821e7-ea03-4546-aed3-c93f9dbaffc1 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:04.673867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7821e7-ea03-4546-aed3-c93f9dbaffc1 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:04.677338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f5d7-e5b8-42b2-8a52-2a4c6d489bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:04.677996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f5d7-e5b8-42b2-8a52-2a4c6d489bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:04.678281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f5d7-e5b8-42b2-8a52-2a4c6d489bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:04.678558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f5d7-e5b8-42b2-8a52-2a4c6d489bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:04.687474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f5d7-e5b8-42b2-8a52-2a4c6d489bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:04.688875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f5d7-e5b8-42b2-8a52-2a4c6d489bb2 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:04.698644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 739/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:14.612451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=11 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:14.693998 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=14 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:24.445921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358dfc8-312e-4daa-97d7-2b1e903ca81d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:24.446550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358dfc8-312e-4daa-97d7-2b1e903ca81d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:24.446550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358dfc8-312e-4daa-97d7-2b1e903ca81d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:24.447865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 732/1471] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:24.453276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96647b7c-d2c9-42c3-9cbe-a3e8a21643b1 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:24.453736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96647b7c-d2c9-42c3-9cbe-a3e8a21643b1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:24.453861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96647b7c-d2c9-42c3-9cbe-a3e8a21643b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:24.471943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-96647b7c-d2c9-42c3-9cbe-a3e8a21643b1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:24.473131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-96647b7c-d2c9-42c3-9cbe-a3e8a21643b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:24.481512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 740/1472] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:24.529558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97839c1-f43d-4937-816d-cf6bd220be72 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:24.529846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97839c1-f43d-4937-816d-cf6bd220be72 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:24.530124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97839c1-f43d-4937-816d-cf6bd220be72 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:24.531465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 733/1473] 10.222.0.47 () {54 vars in 962 bytes} [Thu Jun 30 13:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:24.536386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361fed7-13b9-495a-a45b-bf533e8b7b0b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:24.536675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361fed7-13b9-495a-a45b-bf533e8b7b0b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:24.536956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361fed7-13b9-495a-a45b-bf533e8b7b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:24.555138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9361fed7-13b9-495a-a45b-bf533e8b7b0b None None] MFA Rules not processed for user `ca9f55fa22844a31ba5bc9bff04ab67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:24.556325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9361fed7-13b9-495a-a45b-bf533e8b7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:24.562669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 741/1474] 10.222.0.47 () {58 vars in 1059 bytes} [Thu Jun 30 13:13:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:24.569672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97839c1-f43d-4937-816d-cf6bd220be72 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:24.580071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97839c1-f43d-4937-816d-cf6bd220be72 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:24.583519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c5f66-1c83-4bdb-a779-d9b3542d7124 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca9f55fa22844a31ba5bc9bff04ab67d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:24.584130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c5f66-1c83-4bdb-a779-d9b3542d7124 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:24.584408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c5f66-1c83-4bdb-a779-d9b3542d7124 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:24.584681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c5f66-1c83-4bdb-a779-d9b3542d7124 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:24.594112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c5f66-1c83-4bdb-a779-d9b3542d7124 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:24.595571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c5f66-1c83-4bdb-a779-d9b3542d7124 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:24.605392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 734/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:13:26.690984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7b89-06e1-416b-bee7-ee7536e5e78f None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:26.691515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7b89-06e1-416b-bee7-ee7536e5e78f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:26.691515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7b89-06e1-416b-bee7-ee7536e5e78f None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:26.692855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 742/1476] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:26.698052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934216b3-94d4-42b2-a054-cc207296539d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:26.698485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934216b3-94d4-42b2-a054-cc207296539d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:26.698586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934216b3-94d4-42b2-a054-cc207296539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:26.716466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-934216b3-94d4-42b2-a054-cc207296539d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:26.717676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-934216b3-94d4-42b2-a054-cc207296539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:26.725302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 735/1477] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:26.748587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7b89-06e1-416b-bee7-ee7536e5e78f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:26.760955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7b89-06e1-416b-bee7-ee7536e5e78f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:26.765279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf03e8-5c89-47eb-ab14-49eb861447fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:26.765950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf03e8-5c89-47eb-ab14-49eb861447fa admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:26.766232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf03e8-5c89-47eb-ab14-49eb861447fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:26.766506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf03e8-5c89-47eb-ab14-49eb861447fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:26.767227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf03e8-5c89-47eb-ab14-49eb861447fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:26.768986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-1daf03e8-5c89-47eb-ab14-49eb861447fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:13:26.768986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:13:26.768986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:13:26.770149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf03e8-5c89-47eb-ab14-49eb861447fa admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:26.789798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 743/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Thu Jun 30 13:13:26 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:13:28.813905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e7eb-6a85-4bb4-ba55-44d7c4790d82 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:28.814467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e7eb-6a85-4bb4-ba55-44d7c4790d82 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:28.814467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e7eb-6a85-4bb4-ba55-44d7c4790d82 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:28.815806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 736/1479] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:28.821644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48118-4781-44e6-beff-170a43a6e332 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:28.822086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48118-4781-44e6-beff-170a43a6e332 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:28.822185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48118-4781-44e6-beff-170a43a6e332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:28.839719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a7a48118-4781-44e6-beff-170a43a6e332 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:28.840902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a7a48118-4781-44e6-beff-170a43a6e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:28.848510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 744/1480] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:28.891261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5e7eb-6a85-4bb4-ba55-44d7c4790d82 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:28.905765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5e7eb-6a85-4bb4-ba55-44d7c4790d82 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:28.910987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f09e7-a67b-4e97-b4c6-6c34fabb8bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:28.911613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f09e7-a67b-4e97-b4c6-6c34fabb8bca service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:28.911894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f09e7-a67b-4e97-b4c6-6c34fabb8bca service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:28.912167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f09e7-a67b-4e97-b4c6-6c34fabb8bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:28.920086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f09e7-a67b-4e97-b4c6-6c34fabb8bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:28.921687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f09e7-a67b-4e97-b4c6-6c34fabb8bca service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:28.931410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 737/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:31.119079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff28ad-c578-4703-9d6c-2158ae6ea989 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:31.119633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff28ad-c578-4703-9d6c-2158ae6ea989 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:31.119718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff28ad-c578-4703-9d6c-2158ae6ea989 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:31.121265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 745/1482] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:31.126447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915fe8-4001-4f1c-ad2a-63d912c2df79 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:31.126895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915fe8-4001-4f1c-ad2a-63d912c2df79 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:31.127001 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915fe8-4001-4f1c-ad2a-63d912c2df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:31.144842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-99915fe8-4001-4f1c-ad2a-63d912c2df79 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:31.146057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-99915fe8-4001-4f1c-ad2a-63d912c2df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:31.153735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 738/1483] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:13:31.189494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff28ad-c578-4703-9d6c-2158ae6ea989 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:31.200625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff28ad-c578-4703-9d6c-2158ae6ea989 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:31.204075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c019-6f8f-4749-a06e-fcbb1fdc054a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:31.204702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c019-6f8f-4749-a06e-fcbb1fdc054a service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:31.204985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c019-6f8f-4749-a06e-fcbb1fdc054a service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:31.205266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c019-6f8f-4749-a06e-fcbb1fdc054a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:31.214300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c019-6f8f-4749-a06e-fcbb1fdc054a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:31.215731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c019-6f8f-4749-a06e-fcbb1fdc054a service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:31.225105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 746/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:33.301775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24733-45e9-4fa8-a991-a993807379f5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:33.302326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24733-45e9-4fa8-a991-a993807379f5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:33.302326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24733-45e9-4fa8-a991-a993807379f5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:33.303805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 739/1485] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:33.308888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc9e1-39ec-46d2-a9ce-1346aa196df1 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:33.309334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc9e1-39ec-46d2-a9ce-1346aa196df1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:33.309483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc9e1-39ec-46d2-a9ce-1346aa196df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:33.326849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8bbdc9e1-39ec-46d2-a9ce-1346aa196df1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:33.328046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8bbdc9e1-39ec-46d2-a9ce-1346aa196df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:33.336594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 747/1486] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:33.375683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab24733-45e9-4fa8-a991-a993807379f5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:33.377367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7ab24733-45e9-4fa8-a991-a993807379f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:33.389973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab24733-45e9-4fa8-a991-a993807379f5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:33.393403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d3193-fe35-456c-9fc4-4663f3be89e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:33.394052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3193-fe35-456c-9fc4-4663f3be89e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:33.394332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3193-fe35-456c-9fc4-4663f3be89e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:33.394606 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3193-fe35-456c-9fc4-4663f3be89e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:33.403754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d3193-fe35-456c-9fc4-4663f3be89e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:33.405269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d3193-fe35-456c-9fc4-4663f3be89e7 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:33.415015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 740/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:35.587909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590c232-0d27-4fbf-b697-1810d32bd0da None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:35.588477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590c232-0d27-4fbf-b697-1810d32bd0da None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:35.588477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590c232-0d27-4fbf-b697-1810d32bd0da None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:35.589897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 748/1488] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:35.595200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f1f97-10da-4cec-b366-22e869c218a5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:35.595613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f1f97-10da-4cec-b366-22e869c218a5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:35.595774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f1f97-10da-4cec-b366-22e869c218a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:35.613395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-785f1f97-10da-4cec-b366-22e869c218a5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:35.614557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-785f1f97-10da-4cec-b366-22e869c218a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:35.622847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 741/1489] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:35.662862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590c232-0d27-4fbf-b697-1810d32bd0da None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:35.673384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590c232-0d27-4fbf-b697-1810d32bd0da None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:35.676940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4b43c-01fe-417f-a0e9-7e7faeaaf15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:35.677601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4b43c-01fe-417f-a0e9-7e7faeaaf15e service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:35.677889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4b43c-01fe-417f-a0e9-7e7faeaaf15e service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:35.678662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4b43c-01fe-417f-a0e9-7e7faeaaf15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:35.687500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4b43c-01fe-417f-a0e9-7e7faeaaf15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:35.688917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4b43c-01fe-417f-a0e9-7e7faeaaf15e service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:35.698885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 749/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:37.896564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ca11-d074-459b-bfc8-89c5f1c1d60c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:37.897650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ca11-d074-459b-bfc8-89c5f1c1d60c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:37.897650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ca11-d074-459b-bfc8-89c5f1c1d60c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:37.899013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 742/1491] 10.222.0.47 () {54 vars in 926 bytes} [Thu Jun 30 13:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:13:37.904173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d055c1-6db2-4d60-96b8-826c58eb91e0 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:37.904615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d055c1-6db2-4d60-96b8-826c58eb91e0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:37.904719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d055c1-6db2-4d60-96b8-826c58eb91e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:37.922803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f4d055c1-6db2-4d60-96b8-826c58eb91e0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:13:37.924013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f4d055c1-6db2-4d60-96b8-826c58eb91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:13:37.932688 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 750/1492] 10.222.0.47 () {58 vars in 1023 bytes} [Thu Jun 30 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:13:37.971821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ca11-d074-459b-bfc8-89c5f1c1d60c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:13:37.982417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ca11-d074-459b-bfc8-89c5f1c1d60c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:13:37.986011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdf73f-bc21-4496-97f1-7c9f84af93f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:13:37.986641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf73f-bc21-4496-97f1-7c9f84af93f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:13:37.986926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf73f-bc21-4496-97f1-7c9f84af93f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:13:37.987202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf73f-bc21-4496-97f1-7c9f84af93f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:13:37.996493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdf73f-bc21-4496-97f1-7c9f84af93f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:13:37.997956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdf73f-bc21-4496-97f1-7c9f84af93f0 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:13:38.007957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 743/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:13:47.917814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=33 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:48.003081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=33 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:04.374221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c613-5801-488f-9035-b0dc55f66d59 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.374686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c613-5801-488f-9035-b0dc55f66d59 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.374792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c613-5801-488f-9035-b0dc55f66d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.392583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b405c613-5801-488f-9035-b0dc55f66d59 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:15:04.393801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b405c613-5801-488f-9035-b0dc55f66d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:04.401982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 751/1494] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:15:04.409681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea4ab-76d7-4cae-b700-2a85eca41ea9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.410137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea4ab-76d7-4cae-b700-2a85eca41ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.410237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea4ab-76d7-4cae-b700-2a85eca41ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.427823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b38ea4ab-76d7-4cae-b700-2a85eca41ea9 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:15:04.429003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b38ea4ab-76d7-4cae-b700-2a85eca41ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:04.436701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 744/1495] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:15:04.441442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c613-5801-488f-9035-b0dc55f66d59 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:04.450776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c613-5801-488f-9035-b0dc55f66d59 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:04.455215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:04.455847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.456133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.456406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.457730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:15:04.458035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:04.459034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:04.459034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:15:04.459034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:15:04.459901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:04.471360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 752/1496] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:15:04.479191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea4ab-76d7-4cae-b700-2a85eca41ea9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:04.488336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea4ab-76d7-4cae-b700-2a85eca41ea9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:04.494365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:04.494955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.495202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.495504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.496282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:04.498328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:04.498328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: warnings.warn(msg) Jun 30 13:15:04.498328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: Jun 30 13:15:04.499659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:04.536261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 745/1497] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:15:04 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:15:04.540417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:04.550157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ff2f-6fdd-476a-8669-b346f1e835bf admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:04.604325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:04.604915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.605197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.605624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.606188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:04.607209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:04.607209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:15:04.607209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:15:04.608399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:04.626636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 753/1498] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:15:04 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:15:04.631228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:04.641519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9e7ef-1c45-486d-bf2b-f0a75cf192f2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:04.646498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:04.647148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.647433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.647708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.648452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:04.649444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:04.649444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: warnings.warn(msg) Jun 30 13:15:04.649444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: Jun 30 13:15:04.650345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:04.662784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 746/1499] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:15:04.666458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:04.675987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111c73f-246b-4ed6-9c8d-1fce37adc2f8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:04.680474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62cf6-afd7-4406-b9bc-fea9e91da475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:04.681117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62cf6-afd7-4406-b9bc-fea9e91da475 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.681404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62cf6-afd7-4406-b9bc-fea9e91da475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.681701 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62cf6-afd7-4406-b9bc-fea9e91da475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.682415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62cf6-afd7-4406-b9bc-fea9e91da475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:04.683406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-8bc62cf6-afd7-4406-b9bc-fea9e91da475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:04.683406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:15:04.683406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:15:04.684281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62cf6-afd7-4406-b9bc-fea9e91da475 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:04.697671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 754/1500] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:15:04.701424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:04.712234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4ef8-0d75-400b-a76c-b03b4da2c1e9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:04.717141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ccb37-9449-49af-8f29-ab465bf3872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:04.718215 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ccb37-9449-49af-8f29-ab465bf3872b admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.718504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ccb37-9449-49af-8f29-ab465bf3872b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.718785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ccb37-9449-49af-8f29-ab465bf3872b admin admin] PATH_INFO: `/v3/projects/f93144db94ae4f7cb7d9d81d0960919d/users/509e74566a004ab7a2a289a329ed9593/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.733268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ccb37-9449-49af-8f29-ab465bf3872b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93144db94ae4f7cb7d9d81d0960919d, user_id=509e74566a004ab7a2a289a329ed9593, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:04.734360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-980ccb37-9449-49af-8f29-ab465bf3872b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:04.734360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: warnings.warn(msg) Jun 30 13:15:04.734360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: Jun 30 13:15:04.736274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ccb37-9449-49af-8f29-ab465bf3872b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:04.749128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 747/1501] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:15:04 2022] PUT /identity/v3/projects/f93144db94ae4f7cb7d9d81d0960919d/users/509e74566a004ab7a2a289a329ed9593/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:15:04.761709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5edf09-6be8-4a8e-8b65-a55f20a1efd5 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.761999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5edf09-6be8-4a8e-8b65-a55f20a1efd5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.762277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5edf09-6be8-4a8e-8b65-a55f20a1efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.787176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-db5edf09-6be8-4a8e-8b65-a55f20a1efd5 None None] MFA Rules not processed for user `509e74566a004ab7a2a289a329ed9593`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:15:04.788358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-db5edf09-6be8-4a8e-8b65-a55f20a1efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:04.852501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 755/1502] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:15:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:15:04.866431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335f74-6ac9-4be9-af72-beb037b0994b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.866726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335f74-6ac9-4be9-af72-beb037b0994b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.867012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335f74-6ac9-4be9-af72-beb037b0994b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.868406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 748/1503] 10.222.0.47 () {54 vars in 963 bytes} [Thu Jun 30 13:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:15:04.873198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67143-e6d3-47e4-afa8-afe62d735826 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.873517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67143-e6d3-47e4-afa8-afe62d735826 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.873809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67143-e6d3-47e4-afa8-afe62d735826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.891844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5af67143-e6d3-47e4-afa8-afe62d735826 None None] MFA Rules not processed for user `71a850623f9b43f580dcdc7380ca9ede`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:15:04.893037 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5af67143-e6d3-47e4-afa8-afe62d735826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:04.935010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:04.943595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 756/1504] 10.222.0.47 () {58 vars in 1060 bytes} [Thu Jun 30 13:15:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:15:04.951198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335f74-6ac9-4be9-af72-beb037b0994b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:04.961959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335f74-6ac9-4be9-af72-beb037b0994b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:04.965406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:04.966062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:04.966376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:04.966655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:04.974721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:04.976142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:04.984795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 749/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:15:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:15:05.026264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea64811-3312-40d1-88a5-57f9191223ab None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:05.026561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea64811-3312-40d1-88a5-57f9191223ab None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:05.026842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea64811-3312-40d1-88a5-57f9191223ab None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:05.028192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 757/1506] 10.222.0.47 () {52 vars in 829 bytes} [Thu Jun 30 13:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:15:05.031713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:05.093436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b15d2-c42c-4d11-ab2e-0a02aed59930 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:05.098409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:05.099263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:05.099545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:05.099820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] PATH_INFO: `/v3/users/509e74566a004ab7a2a289a329ed9593` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:05.100987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=509e74566a004ab7a2a289a329ed9593)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:05.102027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:05.102027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: warnings.warn(msg) Jun 30 13:15:05.102027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: Jun 30 13:15:05.103227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:05.165216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509e74566a004ab7a2a289a329ed9593'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.165816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509e74566a004ab7a2a289a329ed9593'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.174318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509e74566a004ab7a2a289a329ed9593'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.192994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509e74566a004ab7a2a289a329ed9593'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.193755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509e74566a004ab7a2a289a329ed9593'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.202163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:05.213414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 750/1507] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:15:05 2022] DELETE /identity/v3/users/509e74566a004ab7a2a289a329ed9593 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:15:05.218044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:05.218457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:05.218658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:05.236184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:15:05.237370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:05.293899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 758/1508] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:15:05.303776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:05.305142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:05.361303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae875-fb42-43b8-87b9-75d58f166ebd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:05.365665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ad57e-70ed-45c5-adb7-69946bca98cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:05.366314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ad57e-70ed-45c5-adb7-69946bca98cf service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:05.366600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ad57e-70ed-45c5-adb7-69946bca98cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:05.366879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ad57e-70ed-45c5-adb7-69946bca98cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:05.375690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ad57e-70ed-45c5-adb7-69946bca98cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:05.377122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ad57e-70ed-45c5-adb7-69946bca98cf service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:05.386490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 751/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:15:05.790297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:05.791761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:05.811850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d15fb-80bb-481e-b663-f27bb95df898 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:05.817705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:05.818581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:05.818861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:05.819136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] PATH_INFO: `/v3/projects/f93144db94ae4f7cb7d9d81d0960919d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:05.820314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93144db94ae4f7cb7d9d81d0960919d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:05.821357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:15:05.821357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:15:05.821357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:15:05.822584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:05.882731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93144db94ae4f7cb7d9d81d0960919d', 'request_id': 'req-5f66571c-d5b9-404d-9d2b-90121c988245'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.896137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93144db94ae4f7cb7d9d81d0960919d', 'request_id': 'req-5f66571c-d5b9-404d-9d2b-90121c988245'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.906506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93144db94ae4f7cb7d9d81d0960919d', 'request_id': 'req-5f66571c-d5b9-404d-9d2b-90121c988245'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.917403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] The token cache is being invalidate because project f93144db94ae4f7cb7d9d81d0960919d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:15:05.917715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.918436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5f66571c-d5b9-404d-9d2b-90121c988245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:15:05.919986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 759/1510] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:15:05 2022] DELETE /identity/v3/projects/f93144db94ae4f7cb7d9d81d0960919d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:15:15.382311 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=29 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:15.914451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:46.534676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150f57-88d9-40cd-a2e1-61f050647381 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:46.535275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150f57-88d9-40cd-a2e1-61f050647381 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:46.535275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150f57-88d9-40cd-a2e1-61f050647381 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:46.536591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:16:46.541506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac65b-87bc-4f6c-a371-b5b370eb2a09 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:46.541934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac65b-87bc-4f6c-a371-b5b370eb2a09 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:46.542094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac65b-87bc-4f6c-a371-b5b370eb2a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:46.560308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4c3ac65b-87bc-4f6c-a371-b5b370eb2a09 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:16:46.561654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4c3ac65b-87bc-4f6c-a371-b5b370eb2a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:16:46.618659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:16:46.770203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150f57-88d9-40cd-a2e1-61f050647381 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:16:46.771900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-40150f57-88d9-40cd-a2e1-61f050647381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:16:46.845346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150f57-88d9-40cd-a2e1-61f050647381 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:16:46.851221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb173e16-e543-49d7-9336-7272dba0919f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:16:46.851861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173e16-e543-49d7-9336-7272dba0919f service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:46.852149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173e16-e543-49d7-9336-7272dba0919f service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:46.852429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173e16-e543-49d7-9336-7272dba0919f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:46.860361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb173e16-e543-49d7-9336-7272dba0919f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:16:46.861972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb173e16-e543-49d7-9336-7272dba0919f service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:16:46.871860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 753/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:16:47.691814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327722-b926-40ed-8f17-399860661bd8 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:47.692348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327722-b926-40ed-8f17-399860661bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:47.692348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327722-b926-40ed-8f17-399860661bd8 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:47.694274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:16:47.699020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cd16-6877-411f-92d0-870b9ca59eb9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:47.699463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cd16-6877-411f-92d0-870b9ca59eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:47.699580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cd16-6877-411f-92d0-870b9ca59eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:47.717791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cb11cd16-6877-411f-92d0-870b9ca59eb9 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:16:47.718973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cb11cd16-6877-411f-92d0-870b9ca59eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:16:47.726643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:16:47.877420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327722-b926-40ed-8f17-399860661bd8 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:16:47.892011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327722-b926-40ed-8f17-399860661bd8 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:16:47.897272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0f5c2-f58e-463b-b1ac-55d5dd96e7be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:16:47.897933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f5c2-f58e-463b-b1ac-55d5dd96e7be service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:47.898219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f5c2-f58e-463b-b1ac-55d5dd96e7be service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:47.898496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f5c2-f58e-463b-b1ac-55d5dd96e7be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:47.906533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0f5c2-f58e-463b-b1ac-55d5dd96e7be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:16:47.908157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0f5c2-f58e-463b-b1ac-55d5dd96e7be service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:16:47.917746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 762/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:16:48.614750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0f559-8e07-45f4-b29d-5ee800d2d69c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:48.614941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0f559-8e07-45f4-b29d-5ee800d2d69c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:48.615223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0f559-8e07-45f4-b29d-5ee800d2d69c None None] PATH_INFO: `/v3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:48.616517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 755/1517] 10.222.0.42 () {54 vars in 925 bytes} [Thu Jun 30 13:16:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:16:48.623151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec80ee-b2ca-45a3-8d59-0f403b625044 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:48.623441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec80ee-b2ca-45a3-8d59-0f403b625044 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:48.623724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec80ee-b2ca-45a3-8d59-0f403b625044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:48.641439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ebec80ee-b2ca-45a3-8d59-0f403b625044 None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:16:48.642673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ebec80ee-b2ca-45a3-8d59-0f403b625044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:16:48.703146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 763/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jun 30 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:16:57.713034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=37 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:57.735913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e5db5-a4ec-4add-8d06-cb404315af40 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:57.736209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e5db5-a4ec-4add-8d06-cb404315af40 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:57.736493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e5db5-a4ec-4add-8d06-cb404315af40 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:57.737900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 756/1519] 10.222.0.47 () {54 vars in 960 bytes} [Thu Jun 30 13:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:16:57.742859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2546cc-7a8a-4549-9b1a-589c928e6e9c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:57.743309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2546cc-7a8a-4549-9b1a-589c928e6e9c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:57.743452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2546cc-7a8a-4549-9b1a-589c928e6e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:57.762615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-1e2546cc-7a8a-4549-9b1a-589c928e6e9c None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:16:57.763804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1e2546cc-7a8a-4549-9b1a-589c928e6e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:16:57.773274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 764/1520] 10.222.0.47 () {58 vars in 1057 bytes} [Thu Jun 30 13:16:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:16:57.781347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e5db5-a4ec-4add-8d06-cb404315af40 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:16:57.794926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e5db5-a4ec-4add-8d06-cb404315af40 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:16:57.799720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c9ecb-6810-4134-a6d0-3bcf3cd60901 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:16:57.800337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9ecb-6810-4134-a6d0-3bcf3cd60901 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:57.800617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9ecb-6810-4134-a6d0-3bcf3cd60901 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:57.800891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9ecb-6810-4134-a6d0-3bcf3cd60901 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:57.808911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c9ecb-6810-4134-a6d0-3bcf3cd60901 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:16:57.810520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c9ecb-6810-4134-a6d0-3bcf3cd60901 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:16:57.819905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 757/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:16:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:16:59.142753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d678772-579f-4235-b71e-1380c7bf302e None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:59.143313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d678772-579f-4235-b71e-1380c7bf302e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:59.143313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d678772-579f-4235-b71e-1380c7bf302e None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:59.144669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:16:59.149342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68180f-18ce-4e30-a8fa-91a5c6b789c6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:59.150321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68180f-18ce-4e30-a8fa-91a5c6b789c6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:59.150428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68180f-18ce-4e30-a8fa-91a5c6b789c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:59.168525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-be68180f-18ce-4e30-a8fa-91a5c6b789c6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:16:59.169750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-be68180f-18ce-4e30-a8fa-91a5c6b789c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:16:59.177346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:16:59.328433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d678772-579f-4235-b71e-1380c7bf302e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:16:59.344444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d678772-579f-4235-b71e-1380c7bf302e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:16:59.350067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb001df-1d80-4d69-8b01-84cce442491f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:16:59.350712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb001df-1d80-4d69-8b01-84cce442491f service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:59.351004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb001df-1d80-4d69-8b01-84cce442491f service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:59.351384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb001df-1d80-4d69-8b01-84cce442491f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:59.359715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb001df-1d80-4d69-8b01-84cce442491f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:16:59.361345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb001df-1d80-4d69-8b01-84cce442491f service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:16:59.370697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 766/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:17:00.187662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed14529-e21e-47cd-8703-d731d31d0b5f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:00.188237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed14529-e21e-47cd-8703-d731d31d0b5f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:00.188237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed14529-e21e-47cd-8703-d731d31d0b5f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:00.189617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 13:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:17:00.194341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9e0b-9852-4642-8c13-4287a3292feb None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:00.194786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9e0b-9852-4642-8c13-4287a3292feb None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:00.194896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9e0b-9852-4642-8c13-4287a3292feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:00.212772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-278c9e0b-9852-4642-8c13-4287a3292feb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:17:00.213989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-278c9e0b-9852-4642-8c13-4287a3292feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:00.221645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:17:00.376044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed14529-e21e-47cd-8703-d731d31d0b5f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:17:00.390300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed14529-e21e-47cd-8703-d731d31d0b5f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:17:00.395652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447d14-b07a-4a3b-9f96-4d0bf0e4f8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:17:00.396282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447d14-b07a-4a3b-9f96-4d0bf0e4f8fa service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:00.396569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447d14-b07a-4a3b-9f96-4d0bf0e4f8fa service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:00.396847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447d14-b07a-4a3b-9f96-4d0bf0e4f8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:00.404921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2447d14-b07a-4a3b-9f96-4d0bf0e4f8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:17:00.406527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2447d14-b07a-4a3b-9f96-4d0bf0e4f8fa service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:17:00.416273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 760/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:17:04.369227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937588-4939-464b-a98f-660be4330658 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:04.369856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937588-4939-464b-a98f-660be4330658 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:04.369856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937588-4939-464b-a98f-660be4330658 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:04.371168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:17:04.376503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c74e-70a6-42fc-858a-74a616876269 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:04.376942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c74e-70a6-42fc-858a-74a616876269 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:04.377051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c74e-70a6-42fc-858a-74a616876269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:04.397434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a9f7c74e-70a6-42fc-858a-74a616876269 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:17:04.398657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a9f7c74e-70a6-42fc-858a-74a616876269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:04.406394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:17:04.442505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937588-4939-464b-a98f-660be4330658 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:17:04.444177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-68937588-4939-464b-a98f-660be4330658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:04.501035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937588-4939-464b-a98f-660be4330658 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:17:04.505761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04566de9-6f87-43c0-961b-3b284cf1e88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:17:04.506477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566de9-6f87-43c0-961b-3b284cf1e88b service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:04.506766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566de9-6f87-43c0-961b-3b284cf1e88b service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:04.507046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566de9-6f87-43c0-961b-3b284cf1e88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:04.517320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04566de9-6f87-43c0-961b-3b284cf1e88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:17:04.518811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04566de9-6f87-43c0-961b-3b284cf1e88b service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:17:04.523669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:04.528659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 769/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:17:06.548423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91808e-9952-4ba9-b2d1-3323eabc3f52 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:06.548980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91808e-9952-4ba9-b2d1-3323eabc3f52 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:06.548980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91808e-9952-4ba9-b2d1-3323eabc3f52 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:06.550370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:17:06.555427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3693de-74ac-4d39-badf-ed66e362e7f5 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:06.555839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3693de-74ac-4d39-badf-ed66e362e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:06.556028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3693de-74ac-4d39-badf-ed66e362e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:06.573579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-da3693de-74ac-4d39-badf-ed66e362e7f5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:17:06.574768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-da3693de-74ac-4d39-badf-ed66e362e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:06.582410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:17:06.619262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91808e-9952-4ba9-b2d1-3323eabc3f52 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:17:06.629768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91808e-9952-4ba9-b2d1-3323eabc3f52 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:17:06.633113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c1380-0d03-4355-bfbc-f92ecbda78fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:17:06.633784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c1380-0d03-4355-bfbc-f92ecbda78fa service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:06.634065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c1380-0d03-4355-bfbc-f92ecbda78fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:06.634336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c1380-0d03-4355-bfbc-f92ecbda78fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:06.643002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c1380-0d03-4355-bfbc-f92ecbda78fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:17:06.644403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c1380-0d03-4355-bfbc-f92ecbda78fa service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:17:06.654100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 763/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:17:10.495179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843d439-aa9f-450c-8e55-9a660fd8b00f None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:10.495705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843d439-aa9f-450c-8e55-9a660fd8b00f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:10.495813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843d439-aa9f-450c-8e55-9a660fd8b00f None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:10.497109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:17:10.502213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6909c-af35-4889-9865-cd8bf913d269 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:10.502614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6909c-af35-4889-9865-cd8bf913d269 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:10.502800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6909c-af35-4889-9865-cd8bf913d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:10.520206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-79c6909c-af35-4889-9865-cd8bf913d269 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:17:10.521412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-79c6909c-af35-4889-9865-cd8bf913d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:10.529691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:17:10.829218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843d439-aa9f-450c-8e55-9a660fd8b00f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:17:10.830890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8843d439-aa9f-450c-8e55-9a660fd8b00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:10.886708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843d439-aa9f-450c-8e55-9a660fd8b00f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:17:10.890248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5f3f6-bf8a-49e6-bf7d-7e675376c83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:17:10.890879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f3f6-bf8a-49e6-bf7d-7e675376c83e service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:10.891160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f3f6-bf8a-49e6-bf7d-7e675376c83e service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:10.891437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f3f6-bf8a-49e6-bf7d-7e675376c83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:10.900644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5f3f6-bf8a-49e6-bf7d-7e675376c83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:17:10.902088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5f3f6-bf8a-49e6-bf7d-7e675376c83e service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:17:10.911209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 772/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:17:12.947219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d024-fb0a-4cb9-8cb4-1aa6b94326d9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:12.947816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d024-fb0a-4cb9-8cb4-1aa6b94326d9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:12.947816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d024-fb0a-4cb9-8cb4-1aa6b94326d9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:12.949147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 13:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:17:12.954346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb0b9e-9bc2-4392-8918-b01262d42b45 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:12.954724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb0b9e-9bc2-4392-8918-b01262d42b45 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:12.954929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb0b9e-9bc2-4392-8918-b01262d42b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:12.972817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8ecb0b9e-9bc2-4392-8918-b01262d42b45 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:17:12.974037 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8ecb0b9e-9bc2-4392-8918-b01262d42b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:12.982228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:17:13.282200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d024-fb0a-4cb9-8cb4-1aa6b94326d9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:17:13.283862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-07e9d024-fb0a-4cb9-8cb4-1aa6b94326d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:17:13.297365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d024-fb0a-4cb9-8cb4-1aa6b94326d9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:17:13.300823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15640-8430-4d9d-a05b-8d75d3ec81a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:17:13.301471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15640-8430-4d9d-a05b-8d75d3ec81a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:17:13.301789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15640-8430-4d9d-a05b-8d75d3ec81a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:17:13.302064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15640-8430-4d9d-a05b-8d75d3ec81a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:17:13.310791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15640-8430-4d9d-a05b-8d75d3ec81a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:17:13.312196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15640-8430-4d9d-a05b-8d75d3ec81a1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:17:13.321419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 766/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:17:22.967677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=32 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:23.317308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=33 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:42.796733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18197863-2634-476b-b21d-0de1c622c4cf None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:42.798322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18197863-2634-476b-b21d-0de1c622c4cf None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:42.798322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18197863-2634-476b-b21d-0de1c622c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:42.819538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-18197863-2634-476b-b21d-0de1c622c4cf None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:42.820786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-18197863-2634-476b-b21d-0de1c622c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:42.835317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 774/1540] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:42.844918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dae2f-fa97-4f5e-a2cf-f7f76e88d1ac None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:42.846005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dae2f-fa97-4f5e-a2cf-f7f76e88d1ac None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:42.846618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dae2f-fa97-4f5e-a2cf-f7f76e88d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:42.874654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-af2dae2f-fa97-4f5e-a2cf-f7f76e88d1ac None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:42.876458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af2dae2f-fa97-4f5e-a2cf-f7f76e88d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:42.888799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 767/1541] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:42.893346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18197863-2634-476b-b21d-0de1c622c4cf None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:42.908495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18197863-2634-476b-b21d-0de1c622c4cf None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:42.912130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:42.912828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:42.913113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:42.913394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:42.914161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:42.914471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:42.916145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:42.933659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 775/1542] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:42.941969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dae2f-fa97-4f5e-a2cf-f7f76e88d1ac None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:42.952855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dae2f-fa97-4f5e-a2cf-f7f76e88d1ac None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:42.962873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:42.963909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:42.964442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:42.964944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:42.965909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:42.968344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.009169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 768/1543] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:42 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:43.013615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.027892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfa1bf-fd7e-405d-b0c1-d6c0482c93a0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.099489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5405-9541-4eb1-bd5c-799ae6631f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.100202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5405-9541-4eb1-bd5c-799ae6631f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.100521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5405-9541-4eb1-bd5c-799ae6631f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.100808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5405-9541-4eb1-bd5c-799ae6631f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.101717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c5405-9541-4eb1-bd5c-799ae6631f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.103953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c5405-9541-4eb1-bd5c-799ae6631f98 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.143709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 776/1544] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:43.147886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.151130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261ac5b-b6b9-4139-9a6f-8c4cea3cef75 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.151532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261ac5b-b6b9-4139-9a6f-8c4cea3cef75 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.152327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261ac5b-b6b9-4139-9a6f-8c4cea3cef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.169236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18240-40a0-4d00-a229-36f94cd18fc6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.179496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.180949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2261ac5b-b6b9-4139-9a6f-8c4cea3cef75 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.183357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2261ac5b-b6b9-4139-9a6f-8c4cea3cef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.184412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.184936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.185408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.186521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.188496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.199596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 777/1545] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.207524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 769/1546] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:43.208882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8352e5c-b1c9-4d19-a9c1-a31ebb32d180 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.209184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8352e5c-b1c9-4d19-a9c1-a31ebb32d180 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.209500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8352e5c-b1c9-4d19-a9c1-a31ebb32d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.211662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.228682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd511e-41f8-49f8-b251-cd394f46c428 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.234786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a8352e5c-b1c9-4d19-a9c1-a31ebb32d180 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.236228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a8352e5c-b1c9-4d19-a9c1-a31ebb32d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.239183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.240159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.240676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.241203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.242224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.244819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.251638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 778/1547] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:18:43.256147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8352e5c-b1c9-4d19-a9c1-a31ebb32d180 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.273307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 770/1548] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:18:43.277073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.279369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8352e5c-b1c9-4d19-a9c1-a31ebb32d180 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.285967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.287146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.287421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.287701 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.288444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:43.288760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.290473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.304419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524de8c9-9cc0-47df-bb88-f9313a07a60c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.311876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 779/1549] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:43.319516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.322913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.323831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.324251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.324530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] PATH_INFO: `/v3/projects/f10be87d3f9d44ef9a57d4843c62bd20/users/31682617bbf342f982f111f44deac3b7/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.345585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9855f-90c1-466a-a64c-e1c869b1adbc admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.351697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e851565-e139-4b8a-b987-ea5a1101a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.351697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e851565-e139-4b8a-b987-ea5a1101a4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.351697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e851565-e139-4b8a-b987-ea5a1101a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.351697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e851565-e139-4b8a-b987-ea5a1101a4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.352161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e851565-e139-4b8a-b987-ea5a1101a4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.353397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-9e851565-e139-4b8a-b987-ea5a1101a4c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:18:43.353397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:18:43.353397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:18:43.361522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e851565-e139-4b8a-b987-ea5a1101a4c3 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.380702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10be87d3f9d44ef9a57d4843c62bd20, user_id=31682617bbf342f982f111f44deac3b7, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.383467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.417075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 780/1550] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:18:43.418742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d770-04a4-4574-b249-31ea3743e865 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.419043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d770-04a4-4574-b249-31ea3743e865 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.419326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d770-04a4-4574-b249-31ea3743e865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.425584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 771/1551] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:43 2022] PUT /identity/v3/projects/f10be87d3f9d44ef9a57d4843c62bd20/users/31682617bbf342f982f111f44deac3b7/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:18:43.426846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.451384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5280d770-04a4-4574-b249-31ea3743e865 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.452984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5280d770-04a4-4574-b249-31ea3743e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.568085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f0ea-55e7-4355-b703-fc085a2e49d8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.581448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 781/1552] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.587019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ed394-1b65-434d-9c2e-8c56b3b4e11e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.587760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ed394-1b65-434d-9c2e-8c56b3b4e11e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.588924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ed394-1b65-434d-9c2e-8c56b3b4e11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.660163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a23ed394-1b65-434d-9c2e-8c56b3b4e11e None None] MFA Rules not processed for user `31682617bbf342f982f111f44deac3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.661972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a23ed394-1b65-434d-9c2e-8c56b3b4e11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.683770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:43.698032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad3bf3-5e14-4837-8b6b-c67b0470b56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.698775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad3bf3-5e14-4837-8b6b-c67b0470b56d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.699063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad3bf3-5e14-4837-8b6b-c67b0470b56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.699345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad3bf3-5e14-4837-8b6b-c67b0470b56d admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.700100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad3bf3-5e14-4837-8b6b-c67b0470b56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.701152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-5bad3bf3-5e14-4837-8b6b-c67b0470b56d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:18:43.701152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: warnings.warn(msg) Jun 30 13:18:43.701152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: Jun 30 13:18:43.702413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad3bf3-5e14-4837-8b6b-c67b0470b56d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.729781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 772/1553] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:43.729781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb3c8-6f95-4836-ba25-0860d1003ed9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.729781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb3c8-6f95-4836-ba25-0860d1003ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.729781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb3c8-6f95-4836-ba25-0860d1003ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.750437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a8abb3c8-6f95-4836-ba25-0860d1003ed9 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.751654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a8abb3c8-6f95-4836-ba25-0860d1003ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.752640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 782/1554] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.753796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927059d-3e96-46ae-8eca-29ac99467e3f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.754042 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927059d-3e96-46ae-8eca-29ac99467e3f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.754319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927059d-3e96-46ae-8eca-29ac99467e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.761541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 773/1555] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.762719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372051-e2b2-4864-9c42-66381ca0b9c3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.763010 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372051-e2b2-4864-9c42-66381ca0b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.763292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372051-e2b2-4864-9c42-66381ca0b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.772877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8927059d-3e96-46ae-8eca-29ac99467e3f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.774153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8927059d-3e96-46ae-8eca-29ac99467e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.781174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b1372051-e2b2-4864-9c42-66381ca0b9c3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.782125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 783/1556] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.782392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b1372051-e2b2-4864-9c42-66381ca0b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.783412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abce37a-1596-425a-8832-a35bdcebfc51 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.783708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abce37a-1596-425a-8832-a35bdcebfc51 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.784739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abce37a-1596-425a-8832-a35bdcebfc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.792442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 774/1557] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.795208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aabd1-52dc-415b-8344-7185447b9e03 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.796465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aabd1-52dc-415b-8344-7185447b9e03 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.796785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aabd1-52dc-415b-8344-7185447b9e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.807205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2abce37a-1596-425a-8832-a35bdcebfc51 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.808418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2abce37a-1596-425a-8832-a35bdcebfc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.815757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a20aabd1-52dc-415b-8344-7185447b9e03 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.816843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 784/1558] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.816984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a20aabd1-52dc-415b-8344-7185447b9e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.817855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abce37a-1596-425a-8832-a35bdcebfc51 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.827410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abce37a-1596-425a-8832-a35bdcebfc51 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.830364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 775/1559] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.832323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.832977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.833548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.833832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.834556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.834798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d346-a3ed-409c-9130-5130899c3ef5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.835092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d346-a3ed-409c-9130-5130899c3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.835378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d346-a3ed-409c-9130-5130899c3ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.836169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.841928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:43.847359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 785/1560] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:43.848461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.856464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9494d346-a3ed-409c-9130-5130899c3ef5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.857698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9494d346-a3ed-409c-9130-5130899c3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.859065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086da7f-313f-482e-983c-0441938ba9f3 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.863601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.864235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.864520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.864799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.865509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.865749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 776/1561] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.866948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0e2a-3353-4393-a320-8e57201dae37 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.867239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0e2a-3353-4393-a320-8e57201dae37 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.867465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.867582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0e2a-3353-4393-a320-8e57201dae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.885844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a7da0e2a-3353-4393-a320-8e57201dae37 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.887126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a7da0e2a-3353-4393-a320-8e57201dae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.895734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 777/1562] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.897224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f2788-57a2-4300-918b-7501ccc37e23 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.897516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f2788-57a2-4300-918b-7501ccc37e23 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.897836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f2788-57a2-4300-918b-7501ccc37e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.902334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 786/1563] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:43.902334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:43.920006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d74f2788-57a2-4300-918b-7501ccc37e23 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:43.921208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d74f2788-57a2-4300-918b-7501ccc37e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:43.962181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def630-951c-4d74-9708-b0d6dfd842b9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:43.966914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea7e4b-5d43-4200-9462-f5c2950e3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:43.967648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7e4b-5d43-4200-9462-f5c2950e3fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.967938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7e4b-5d43-4200-9462-f5c2950e3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.968214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7e4b-5d43-4200-9462-f5c2950e3fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.969060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea7e4b-5d43-4200-9462-f5c2950e3fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:43.969378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea7e4b-5d43-4200-9462-f5c2950e3fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:43.971047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea7e4b-5d43-4200-9462-f5c2950e3fc7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:43.981091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 778/1564] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:43.982617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0bbe-e130-4c1d-a741-3cfbfb460140 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.982903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0bbe-e130-4c1d-a741-3cfbfb460140 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.983183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0bbe-e130-4c1d-a741-3cfbfb460140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:43.983342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 787/1565] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:43.984571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296284-1ba5-4343-a478-63956d01e0dc None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:43.984864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296284-1ba5-4343-a478-63956d01e0dc None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:43.985143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296284-1ba5-4343-a478-63956d01e0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.001098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-df0e0bbe-e130-4c1d-a741-3cfbfb460140 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:44.002329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-df0e0bbe-e130-4c1d-a741-3cfbfb460140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:44.002886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d4296284-1ba5-4343-a478-63956d01e0dc None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:44.004061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d4296284-1ba5-4343-a478-63956d01e0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:44.010135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 779/1566] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:44.010889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0bbe-e130-4c1d-a741-3cfbfb460140 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.011915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 788/1567] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:44.013102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274deb7-bbdd-4bf8-8b54-c5ca4ce80e0c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.013388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274deb7-bbdd-4bf8-8b54-c5ca4ce80e0c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.013852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274deb7-bbdd-4bf8-8b54-c5ca4ce80e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.023758 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0bbe-e130-4c1d-a741-3cfbfb460140 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.028861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.029551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.029835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.030111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.030831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.031389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a274deb7-bbdd-4bf8-8b54-c5ca4ce80e0c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:44.032448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.032563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a274deb7-bbdd-4bf8-8b54-c5ca4ce80e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:44.041100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 789/1568] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:44.042220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274deb7-bbdd-4bf8-8b54-c5ca4ce80e0c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.043120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 780/1569] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:44.043775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.053102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dbbb1-0ba1-4f7a-9272-a5c003df8f95 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.054414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274deb7-bbdd-4bf8-8b54-c5ca4ce80e0c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.057831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.058460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.058745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.059020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.059275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.059693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.059910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.060189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.060462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.061174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:44.061508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.061605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.063108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.075867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 790/1570] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:44.077209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.084935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 781/1571] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/users => generated 294 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.086000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.089273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9ad2-79c9-48ec-9c63-eedea408ecf4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.093897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.094537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.094818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.095089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.095772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.096131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43957-9f9a-4bd6-8e31-bd0948bd56ee admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.097731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.100938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.101646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.101929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.102741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.103607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:44.103914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.104936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:18:44.104936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: warnings.warn(msg) Jun 30 13:18:44.104936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: Jun 30 13:18:44.105885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.118318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 782/1572] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:44.119099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.126361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 791/1573] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.126361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.132071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6cbed-ff68-4422-802c-34f0c158a20a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.136456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:44.188706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3466-7df3-452e-aa2d-97e93129d6b5 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.188958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.189648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.189933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.190210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.190927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:44.191232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.192873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.193260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.193958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.194228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.194503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.195217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:44.195521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.197198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.204646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 783/1574] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:44.204646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.212829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 792/1575] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:44.212829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.220245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860121f-9a4e-4212-8d83-456eb75fbedb admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.220424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905230d-3529-477e-aee7-26d2c92a92da admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.224702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.224883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.225571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.225687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.225861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.225972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.226140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] PATH_INFO: `/v3/projects/f532809dd47346688a31a07ae1352dc4/users/bcbee88914f340cf8fa774b0049fe45d/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.226255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.226847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:44.227833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.229426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.241117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f532809dd47346688a31a07ae1352dc4, user_id=bcbee88914f340cf8fa774b0049fe45d, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.241749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 784/1576] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:44.242271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:18:44.242271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:18:44.242271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:18:44.242506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.244782 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.257317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88601d-f160-474e-948d-4177f521dd92 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.259097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 793/1577] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:44 2022] PUT /identity/v3/projects/f532809dd47346688a31a07ae1352dc4/users/bcbee88914f340cf8fa774b0049fe45d/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:44.259893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.282190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:44.321407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.322204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.322489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.322789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.323481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.325378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.326097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7aaa-9dea-433f-b1ac-cdb06fcc1b5f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.330600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.331256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.331538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.331813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.332530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.334449 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.344894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 794/1578] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:44.345734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.351492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 785/1579] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.352844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.359113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f849b-77f2-479e-9568-b734aa76659e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.415516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680501ff-7454-44d0-ba1f-1d7ed4ab4c30 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.416339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.417000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.417292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.417607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.418300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.420211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.420376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.421058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.421340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.421661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.422333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.424230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.445676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 795/1580] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.446404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.450114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:44.454846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 786/1581] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.454846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.463154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7fc5-4240-4760-8672-1fa066a094c8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.511116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c04ffd-cd54-494b-b45b-03462c4a9227 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.516335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.516993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.517281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.517600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.518304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.520216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.521332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5276a-a3c0-4533-9546-a87b1208998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.522029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5276a-a3c0-4533-9546-a87b1208998b admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.522316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5276a-a3c0-4533-9546-a87b1208998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.522584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5276a-a3c0-4533-9546-a87b1208998b admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.523268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5276a-a3c0-4533-9546-a87b1208998b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.525197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5276a-a3c0-4533-9546-a87b1208998b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.548129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 796/1582] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.548939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.556884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 787/1583] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.556884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f827d-ed88-4db2-a0ec-4ce3b28c9968 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.556884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f827d-ed88-4db2-a0ec-4ce3b28c9968 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.556884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f827d-ed88-4db2-a0ec-4ce3b28c9968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.582006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-261f827d-ed88-4db2-a0ec-4ce3b28c9968 None None] MFA Rules not processed for user `bcbee88914f340cf8fa774b0049fe45d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:44.583455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-261f827d-ed88-4db2-a0ec-4ce3b28c9968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:44.592318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:44.615367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33583b7-1975-4d1d-8018-9a5153668a1a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.647774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 788/1584] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:44.648602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f827d-ed88-4db2-a0ec-4ce3b28c9968 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.677243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.678133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.678420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.678700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.679395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.681328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.711066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 797/1585] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.714407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.720694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f827d-ed88-4db2-a0ec-4ce3b28c9968 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.736727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:44.776841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.777539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.777822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.778092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.778810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.779648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81bf5c-3d11-447a-8405-f18a4861e233 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.780406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.784253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.784914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.785199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.785733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.786184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.788074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.790878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 789/1586] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:44.790878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.803653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2b88-cbe7-4073-a30f-d4299365ed63 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.808361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.808612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 798/1587] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.809160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.809445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.809758 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.810141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.810486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.812423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.819715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bfb26-42a2-4180-90cc-fa064d888850 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.826121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.827123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.827495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.827775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.828496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.830134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.833669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 790/1588] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.834625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.841280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 799/1589] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:44.845090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.845549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90d10-bfce-415d-958b-b584f3ed03c3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.850006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c2ea3-8dd9-4216-8012-0aee887855c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.850652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2ea3-8dd9-4216-8012-0aee887855c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.850938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2ea3-8dd9-4216-8012-0aee887855c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.851213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2ea3-8dd9-4216-8012-0aee887855c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.851885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c2ea3-8dd9-4216-8012-0aee887855c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.854469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c2ea3-8dd9-4216-8012-0aee887855c9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.854965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70333d73-0f47-4651-b8ae-7fc0afc46f80 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.859511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.860142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.860423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.860698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.861372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.863501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.873148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 791/1590] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/users => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.876284 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534c1a-215d-4579-8f15-e4fbfe297966 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.876580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534c1a-215d-4579-8f15-e4fbfe297966 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.876928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534c1a-215d-4579-8f15-e4fbfe297966 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.878509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 792/1591] 10.222.0.47 () {54 vars in 961 bytes} [Thu Jun 30 13:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:18:44.879103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534c1a-215d-4579-8f15-e4fbfe297966 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.889606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 800/1592] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.889606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.894509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534c1a-215d-4579-8f15-e4fbfe297966 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.896926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df0af-cfef-4fcc-958e-ef03d9012853 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.899664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.900452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.900734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.901028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.901732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.902915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.903672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.903801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.904047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.904323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] PATH_INFO: `/v3/projects/3972085479d543ef8c68c13649b1aad2/users/7c3a28bf2ab547d590743826f6c78887/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.919799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3972085479d543ef8c68c13649b1aad2, user_id=7c3a28bf2ab547d590743826f6c78887, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.922472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:44.924875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 793/1593] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:44 2022] POST /identity/v3/users => generated 296 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:44.925863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.931417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:44.936812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de07ff-afd4-40f7-9495-c9ffc7eef383 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:44.940096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 801/1594] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:44 2022] PUT /identity/v3/projects/3972085479d543ef8c68c13649b1aad2/users/7c3a28bf2ab547d590743826f6c78887/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:44.941178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:44.995664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:44.996337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:44.996619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:44.996894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:44.997647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:44.999252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.008085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e924b-aac5-4301-8aea-e6b73a2b0fa4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.009326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 794/1595] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.013341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.013763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.014431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.014746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.015050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.015769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.017355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.022707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d856267-5942-45de-b9ef-f761862187ee admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.028153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c089c9b-2ec4-41f3-bea9-8fd9f31e7b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.031479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 802/1596] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.031607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c089c9b-2ec4-41f3-bea9-8fd9f31e7b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.031607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c089c9b-2ec4-41f3-bea9-8fd9f31e7b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.031607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c089c9b-2ec4-41f3-bea9-8fd9f31e7b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.031843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.031951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c089c9b-2ec4-41f3-bea9-8fd9f31e7b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.031951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c089c9b-2ec4-41f3-bea9-8fd9f31e7b65 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.039300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65dfc-8027-40d6-bfd7-59a0e0463904 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.044486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 795/1597] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.044486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6c59-86c5-47f0-a2a2-1f4f48c408e9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.044486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6c59-86c5-47f0-a2a2-1f4f48c408e9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.044486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6c59-86c5-47f0-a2a2-1f4f48c408e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.044893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.044893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.045095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.045231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.050133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.051728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.060899 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-141d6c59-86c5-47f0-a2a2-1f4f48c408e9 None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:45.061985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 803/1598] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.062236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-141d6c59-86c5-47f0-a2a2-1f4f48c408e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:45.062840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.072771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d0d5-565a-4190-a268-a6ab05be26be admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.077478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.084600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.084891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.085165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.085912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.088025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.098408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 804/1599] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.098408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.108616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a36c78-5664-4fda-a8a2-323d9c00e0ba admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.113163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a263df8-c1b0-48b0-8645-86f489bdcb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.113813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a263df8-c1b0-48b0-8645-86f489bdcb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.114096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a263df8-c1b0-48b0-8645-86f489bdcb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.114373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a263df8-c1b0-48b0-8645-86f489bdcb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.115068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a263df8-c1b0-48b0-8645-86f489bdcb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.116599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a263df8-c1b0-48b0-8645-86f489bdcb8d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.126553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 805/1600] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.127761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6346-46b6-4994-9903-57c899fadee0 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.128047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6346-46b6-4994-9903-57c899fadee0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.128323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6346-46b6-4994-9903-57c899fadee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.132298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 796/1601] 10.222.0.47 () {58 vars in 1058 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:45.133126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d6c59-86c5-47f0-a2a2-1f4f48c408e9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.143576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d6c59-86c5-47f0-a2a2-1f4f48c408e9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.150421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.151076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.151355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.151625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.152346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.154408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.155852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5b7f6346-46b6-4994-9903-57c899fadee0 None None] MFA Rules not processed for user `7c3a28bf2ab547d590743826f6c78887`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:45.157103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5b7f6346-46b6-4994-9903-57c899fadee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:45.164231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 797/1602] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.165119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.165252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:45.175565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3ee2-1339-4c85-930d-1c584dc7a6eb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.180476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.181114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.181406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.181695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.182439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.184037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.193667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 798/1603] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.194417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.204553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7eef4-03e2-4eb8-abda-bc56dfd55926 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.209439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.210309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.210594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.210871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] PATH_INFO: `/v3/projects/72a2cb47cea04a3dbbcfa022928c8c6a/users/528b973b7a73413482b088ed6ada4f3f/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.225695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a2cb47cea04a3dbbcfa022928c8c6a, user_id=528b973b7a73413482b088ed6ada4f3f, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.228029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 806/1604] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:45.228863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6346-46b6-4994-9903-57c899fadee0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.229914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.239710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6346-46b6-4994-9903-57c899fadee0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.244544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 799/1605] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:45 2022] PUT /identity/v3/projects/72a2cb47cea04a3dbbcfa022928c8c6a/users/528b973b7a73413482b088ed6ada4f3f/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:45.245345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.279732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:45.302814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.303619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.303970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.304311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.305097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.306841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.307488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7728-b086-477c-87d4-fffe40604c29 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.312226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.312888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.313171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.313449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.314267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.315841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.317226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 807/1606] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.318053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.328121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31623e8-17a0-4330-8d6c-8d8146a34038 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.332395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 800/1607] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.332395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.333870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.334081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.334644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.334644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.335299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.339243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.349856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 808/1608] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:45.352785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.362450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6560f9-d49f-41c0-b59a-2fe9d2e436d0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.367005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.368379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.368658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.368929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] PATH_INFO: `/v3/projects/0bf116027454478d8f7d529a6feab0d1/users/2ff9fc7740a4445bbffb513ec7b8f00d/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.383189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf116027454478d8f7d529a6feab0d1, user_id=2ff9fc7740a4445bbffb513ec7b8f00d, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.386408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.399145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 809/1609] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:45 2022] PUT /identity/v3/projects/0bf116027454478d8f7d529a6feab0d1/users/2ff9fc7740a4445bbffb513ec7b8f00d/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:45.400099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.413859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63e17-f806-4c7d-9b61-405a55fbec9a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.460949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6a903-331f-49bf-b958-69fc3b201728 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.465951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.466863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.467153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.467438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] PATH_INFO: `/v3/projects/435105e2cd5c4398aa97b27df6485c89/users/0281a2bde51542e6af4ad2a23befe12b/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.477683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6544222-d3f8-4a8e-b322-ba6a5d0fa445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.478331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6544222-d3f8-4a8e-b322-ba6a5d0fa445 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.478615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6544222-d3f8-4a8e-b322-ba6a5d0fa445 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.478895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6544222-d3f8-4a8e-b322-ba6a5d0fa445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.481935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435105e2cd5c4398aa97b27df6485c89, user_id=0281a2bde51542e6af4ad2a23befe12b, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.484592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.486828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:45.500032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 810/1610] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:45 2022] PUT /identity/v3/projects/435105e2cd5c4398aa97b27df6485c89/users/0281a2bde51542e6af4ad2a23befe12b/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:45.500811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.539495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6544222-d3f8-4a8e-b322-ba6a5d0fa445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.541419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6544222-d3f8-4a8e-b322-ba6a5d0fa445 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.550849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 801/1611] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:45.552284 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64677-6d45-4869-8c85-aa3729dc90fc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.552640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64677-6d45-4869-8c85-aa3729dc90fc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.552904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64677-6d45-4869-8c85-aa3729dc90fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.560643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:45.561208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b31f5-404b-42cb-bb5a-759d7a47e1a6 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.566792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.567452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.567737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.568027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.568704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.570628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.582510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9ec64677-6d45-4869-8c85-aa3729dc90fc None None] MFA Rules not processed for user `528b973b7a73413482b088ed6ada4f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:45.584137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ec64677-6d45-4869-8c85-aa3729dc90fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:45.601112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 811/1612] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:45.605544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.657512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 802/1613] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:45.657512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec64677-6d45-4869-8c85-aa3729dc90fc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.666800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec64677-6d45-4869-8c85-aa3729dc90fc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.678558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08500bc-9a78-4c3a-bdf8-170166b6cec8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.684155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.685281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.685779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.686129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] PATH_INFO: `/v3/projects/52a55063a6304fafb4211384d12bd2a4/users/3ed225bee1dd41a6b5c2c38d785f2d81/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.702930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a55063a6304fafb4211384d12bd2a4, user_id=3ed225bee1dd41a6b5c2c38d785f2d81, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.705608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.720760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 812/1614] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:45 2022] PUT /identity/v3/projects/52a55063a6304fafb4211384d12bd2a4/users/3ed225bee1dd41a6b5c2c38d785f2d81/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:45.724680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.730294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54126e5-bc4f-4f26-b209-befdb908b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.731187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54126e5-bc4f-4f26-b209-befdb908b1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.731497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54126e5-bc4f-4f26-b209-befdb908b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.731771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54126e5-bc4f-4f26-b209-befdb908b1fc admin admin] PATH_INFO: `/v3/projects/3d90773633704c39944014a3cb7c7440/users/eb7f4d2ef2964c5f8d4adac2c8eecc1b/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.747021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54126e5-bc4f-4f26-b209-befdb908b1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d90773633704c39944014a3cb7c7440, user_id=eb7f4d2ef2964c5f8d4adac2c8eecc1b, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.749694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54126e5-bc4f-4f26-b209-befdb908b1fc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.773550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 803/1615] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:45 2022] PUT /identity/v3/projects/3d90773633704c39944014a3cb7c7440/users/eb7f4d2ef2964c5f8d4adac2c8eecc1b/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:45.775896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8154c-911b-4bd9-ad2f-4d60dfca65bb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.776550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8154c-911b-4bd9-ad2f-4d60dfca65bb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.776816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8154c-911b-4bd9-ad2f-4d60dfca65bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.794320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6ed8-f5a0-4570-b8d5-bf88096d33f6 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.798834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:45.803330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-45a8154c-911b-4bd9-ad2f-4d60dfca65bb None None] MFA Rules not processed for user `2ff9fc7740a4445bbffb513ec7b8f00d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:45.804520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-45a8154c-911b-4bd9-ad2f-4d60dfca65bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:45.855174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.856168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.856534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.856876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] PATH_INFO: `/v3/projects/15273ac34cca4da1b9375524bade1873/users/640e3ad3e6174e8e86333ae5c1a907ca/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.871788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15273ac34cca4da1b9375524bade1873, user_id=640e3ad3e6174e8e86333ae5c1a907ca, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.874669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.878918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 804/1616] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:45.880204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689ad4-4c55-4e5e-b7fe-acecffe03ee4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.880486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689ad4-4c55-4e5e-b7fe-acecffe03ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.880794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689ad4-4c55-4e5e-b7fe-acecffe03ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.893155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 813/1617] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:45 2022] PUT /identity/v3/projects/15273ac34cca4da1b9375524bade1873/users/640e3ad3e6174e8e86333ae5c1a907ca/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:45.894067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.897778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:45.901957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1c689ad4-4c55-4e5e-b7fe-acecffe03ee4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:45.903134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1c689ad4-4c55-4e5e-b7fe-acecffe03ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:45.957678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bc38-d7aa-433a-bd5d-7508f00076b0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.961877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 805/1618] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:45.962790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689ad4-4c55-4e5e-b7fe-acecffe03ee4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:45.965851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81e70c-973f-4692-83c7-e21fc406bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.966360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e70c-973f-4692-83c7-e21fc406bb0a admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.966646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e70c-973f-4692-83c7-e21fc406bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.966921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e70c-973f-4692-83c7-e21fc406bb0a admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.967607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e70c-973f-4692-83c7-e21fc406bb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.969565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e70c-973f-4692-83c7-e21fc406bb0a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.974309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689ad4-4c55-4e5e-b7fe-acecffe03ee4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:45.979420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f91164-4eb9-45f2-a3ff-5c54222262b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:45.980072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91164-4eb9-45f2-a3ff-5c54222262b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.980358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91164-4eb9-45f2-a3ff-5c54222262b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.980645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91164-4eb9-45f2-a3ff-5c54222262b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:45.981568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f91164-4eb9-45f2-a3ff-5c54222262b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:45.983756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f91164-4eb9-45f2-a3ff-5c54222262b5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:45.994733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 814/1619] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:45.994733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81baa-4e5b-4366-9506-8f097ec1bdcb None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:45.994733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81baa-4e5b-4366-9506-8f097ec1bdcb None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:45.994733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81baa-4e5b-4366-9506-8f097ec1bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.011170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-28d81baa-4e5b-4366-9506-8f097ec1bdcb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:46.012386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-28d81baa-4e5b-4366-9506-8f097ec1bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:46.013282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 806/1620] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:46.014876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849db92e-e2aa-4483-9825-8d3827d47ff4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.015168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849db92e-e2aa-4483-9825-8d3827d47ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.015449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849db92e-e2aa-4483-9825-8d3827d47ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.040732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-849db92e-e2aa-4483-9825-8d3827d47ff4 None None] MFA Rules not processed for user `eb7f4d2ef2964c5f8d4adac2c8eecc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:46.041957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-849db92e-e2aa-4483-9825-8d3827d47ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:46.072159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 815/1621] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:46.073437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fd8b4-be68-4267-a1fb-786edd2a5ed0 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.073754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fd8b4-be68-4267-a1fb-786edd2a5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.074028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fd8b4-be68-4267-a1fb-786edd2a5ed0 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.075435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 816/1622] 10.222.0.47 () {54 vars in 912 bytes} [Thu Jun 30 13:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:18:46.079492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fd8b4-be68-4267-a1fb-786edd2a5ed0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.106701 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:46.110132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 807/1623] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:46.111522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412079-95d3-43b9-a3fc-d0828c99294c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.111812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412079-95d3-43b9-a3fc-d0828c99294c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.112093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412079-95d3-43b9-a3fc-d0828c99294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.129576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a6412079-95d3-43b9-a3fc-d0828c99294c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:46.130777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a6412079-95d3-43b9-a3fc-d0828c99294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:46.138259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 808/1624] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:46.139416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fd8b4-be68-4267-a1fb-786edd2a5ed0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.142238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6412079-95d3-43b9-a3fc-d0828c99294c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.144119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.144743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.145039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.145323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.195690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6412079-95d3-43b9-a3fc-d0828c99294c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.199253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.199890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.200171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.200444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.204121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.205622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.209608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.211011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.215524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 817/1625] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:46.216420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.221675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 809/1626] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:46.222436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.227860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c36123-bee0-4489-aad2-7dc1561f412a service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.232451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0804e1-f6b3-447c-8881-4767b65bdcd3 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.232590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbfa05-99d2-40b7-9f1f-fe70e669bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.233243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbfa05-99d2-40b7-9f1f-fe70e669bf13 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.233861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbfa05-99d2-40b7-9f1f-fe70e669bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.234142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbfa05-99d2-40b7-9f1f-fe70e669bf13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.234874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbfa05-99d2-40b7-9f1f-fe70e669bf13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.236478 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbfa05-99d2-40b7-9f1f-fe70e669bf13 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.237298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.237988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.238270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.238545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.239230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.241121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.247966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 818/1627] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:46.249488 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.249783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.250068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.253668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:46.271604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:46.272815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:46.273575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 810/1628] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:46 2022] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:46.274706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.284688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d952-5f88-4fbc-a2b0-84f613ac2a63 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.288514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.289162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.289448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.290912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.301842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.303399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.317599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 811/1629] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:46.318423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.333884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0558887-57d9-4126-a711-2a01db10eaf2 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.353080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.354518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.356120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.356120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.356840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.359777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.379612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 819/1630] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:46.380933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.382638 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:46.398358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 812/1631] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:46 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:46.398766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55227f8d-cc15-4944-87f4-6a0c57164568 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.400094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.463552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.464492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.464786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.465061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.476773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:46.480799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3fcfb-4f0d-4e8b-b3c9-63a147613db2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.487714 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.488886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.489148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.489431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] PATH_INFO: `/v3/projects/60c947d7fff44fd4824aac786e1a695b/users/898ec4a6253a4cf486075c138f76b3d9/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.509688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c947d7fff44fd4824aac786e1a695b, user_id=898ec4a6253a4cf486075c138f76b3d9, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.513019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.534161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 813/1632] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:46 2022] PUT /identity/v3/projects/60c947d7fff44fd4824aac786e1a695b/users/898ec4a6253a4cf486075c138f76b3d9/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:46.537214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.550222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.551890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.567912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 820/1633] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:46.568923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.640035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eebe9-7717-4011-bb98-8ac8722f24eb service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.640912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1dc8-4f0e-4507-b479-f2a90e753a3c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.647336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.648257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.648693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.650012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.650949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.653031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.666534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 814/1634] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:46.667905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.681131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71415d-154d-4c9a-9afa-f6b6dfdc8f0a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.688237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.689037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.689419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.690440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.691613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.693898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.723996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.724752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.724999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.725339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.727020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 815/1635] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:46 2022] POST /identity/v3/users => generated 288 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:46.728455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.743645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063dd64-3386-4f95-b45b-39441c01d4bd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.750542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.751378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.751856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.752241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.753909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.756514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.775361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 816/1636] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:46.776006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.793844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8f1ea-3801-47f1-9171-dc7d3cf2b061 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.805242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:46.807652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:46.807941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:46.808258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] PATH_INFO: `/v3/projects/6677c0a5a4de4434af41233b452a156e/users/0de8adb39c484e92a2e5eca03f8a166f/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:46.817048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:46.834791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.837387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.840547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6677c0a5a4de4434af41233b452a156e, user_id=0de8adb39c484e92a2e5eca03f8a166f, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:46.844245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:46.857820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 821/1637] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:46.859955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.861725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 817/1638] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:46 2022] PUT /identity/v3/projects/6677c0a5a4de4434af41233b452a156e/users/0de8adb39c484e92a2e5eca03f8a166f/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:46.862949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:46.872900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:46.894856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc3deb-248d-4e82-b2c3-1b2287eab548 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:46.989888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10be3-946d-4e93-99bf-d74db4ae65f7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.002397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.003316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.003605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.003885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] PATH_INFO: `/v3/projects/60c947d7fff44fd4824aac786e1a695b/users/898ec4a6253a4cf486075c138f76b3d9/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.009067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c947d7fff44fd4824aac786e1a695b, user_id=898ec4a6253a4cf486075c138f76b3d9, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.014631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.022445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.023260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.023553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.023835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.024619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.026403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.037897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 822/1639] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:47.038842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:47.043583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 818/1640] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:46 2022] PUT /identity/v3/projects/60c947d7fff44fd4824aac786e1a695b/users/898ec4a6253a4cf486075c138f76b3d9/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:47.044417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:47.060098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041de2-b274-4c76-bb32-e45c1731c591 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.135787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8be0c-2e1e-4485-92b4-c0743faf4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.136483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8be0c-2e1e-4485-92b4-c0743faf4f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.136832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8be0c-2e1e-4485-92b4-c0743faf4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.137120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8be0c-2e1e-4485-92b4-c0743faf4f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.137885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8be0c-2e1e-4485-92b4-c0743faf4f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.139518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8be0c-2e1e-4485-92b4-c0743faf4f42 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.167995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 823/1641] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:47.172026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce2f42-fc3d-4d09-80ac-a8970b22cda8 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.172325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce2f42-fc3d-4d09-80ac-a8970b22cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.172615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce2f42-fc3d-4d09-80ac-a8970b22cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.239825 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-92ce2f42-fc3d-4d09-80ac-a8970b22cda8 None None] MFA Rules not processed for user `898ec4a6253a4cf486075c138f76b3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:47.242136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-92ce2f42-fc3d-4d09-80ac-a8970b22cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:47.261345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3e1df-5e2b-490d-9d30-b297af3e77e6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.267373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.269221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.270334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.270850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] PATH_INFO: `/v3/projects/ba1b7621bc9940e7895b1fd110a6f717/users/825d9f488679412d9fa4c5771dbd5efb/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.293686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1b7621bc9940e7895b1fd110a6f717, user_id=825d9f488679412d9fa4c5771dbd5efb, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.297443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.320585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 819/1642] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:47 2022] PUT /identity/v3/projects/ba1b7621bc9940e7895b1fd110a6f717/users/825d9f488679412d9fa4c5771dbd5efb/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:47.320585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:47.417756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 824/1643] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:47.418788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce2f42-fc3d-4d09-80ac-a8970b22cda8 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:47.441169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce2f42-fc3d-4d09-80ac-a8970b22cda8 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.470492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950fef-7519-48a6-b1aa-ca2ff6a75858 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.491509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.492461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.493359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.493716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] PATH_INFO: `/v3/projects/6677c0a5a4de4434af41233b452a156e/users/0de8adb39c484e92a2e5eca03f8a166f/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.495932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6677c0a5a4de4434af41233b452a156e, user_id=0de8adb39c484e92a2e5eca03f8a166f, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.498771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.504004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:47.525801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 820/1644] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:47 2022] PUT /identity/v3/projects/6677c0a5a4de4434af41233b452a156e/users/0de8adb39c484e92a2e5eca03f8a166f/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:47.526849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:47.545886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:47.623873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e24fc-f4bd-4521-9987-02d862d8bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.625340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e24fc-f4bd-4521-9987-02d862d8bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.625781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e24fc-f4bd-4521-9987-02d862d8bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.626071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e24fc-f4bd-4521-9987-02d862d8bf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.627215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e24fc-f4bd-4521-9987-02d862d8bf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.630609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e24fc-f4bd-4521-9987-02d862d8bf65 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.656539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 825/1645] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:47.656539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe451-a0c3-4e2d-b572-94713dc7d260 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.656843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332091ae-af17-4ce2-a96b-1e8232be9774 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.656929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe451-a0c3-4e2d-b572-94713dc7d260 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.656929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe451-a0c3-4e2d-b572-94713dc7d260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.674283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.675192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.675535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.675975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.725494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e62fe451-a0c3-4e2d-b572-94713dc7d260 None None] MFA Rules not processed for user `0de8adb39c484e92a2e5eca03f8a166f`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:47.729323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e62fe451-a0c3-4e2d-b572-94713dc7d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:47.768302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.770877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.788221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 821/1646] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:47.789453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:47.944120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 826/1647] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:47.956385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fe451-a0c3-4e2d-b572-94713dc7d260 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:47.971558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470727e5-db8d-4289-a25e-6bc4fda8fabf service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.981219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fe451-a0c3-4e2d-b572-94713dc7d260 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:47.981433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c6daf-1b42-4495-b367-eb6aa25642c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.981801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c6daf-1b42-4495-b367-eb6aa25642c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.982261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c6daf-1b42-4495-b367-eb6aa25642c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.982621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c6daf-1b42-4495-b367-eb6aa25642c3 admin admin] PATH_INFO: `/v3/projects/ba1b7621bc9940e7895b1fd110a6f717/users/825d9f488679412d9fa4c5771dbd5efb/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:47.990688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c6daf-1b42-4495-b367-eb6aa25642c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1b7621bc9940e7895b1fd110a6f717, user_id=825d9f488679412d9fa4c5771dbd5efb, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:47.997653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c6daf-1b42-4495-b367-eb6aa25642c3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:47.998436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:47.999216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:47.999592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:47.999967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.022135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 822/1648] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:47 2022] PUT /identity/v3/projects/ba1b7621bc9940e7895b1fd110a6f717/users/825d9f488679412d9fa4c5771dbd5efb/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:48.033332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a09c0-4e9d-40f8-bc0d-2b5e857ff146 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.033564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a09c0-4e9d-40f8-bc0d-2b5e857ff146 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.033780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a09c0-4e9d-40f8-bc0d-2b5e857ff146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.038022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:48.039639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:48.075972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 827/1649] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:18:48.108597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-293a09c0-4e9d-40f8-bc0d-2b5e857ff146 None None] MFA Rules not processed for user `825d9f488679412d9fa4c5771dbd5efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:48.109871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-293a09c0-4e9d-40f8-bc0d-2b5e857ff146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:48.227506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:48.296604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:48.305838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e0ed-54a2-43c7-98dd-aad47535bf4d service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:48.330840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 823/1650] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:18:48.417026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:48.417961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.418358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.418777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.438068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98f88-6345-4dec-8d2e-5d4fbad65866 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.438607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98f88-6345-4dec-8d2e-5d4fbad65866 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.439035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98f88-6345-4dec-8d2e-5d4fbad65866 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.442825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 824/1651] 10.222.0.47 () {54 vars in 961 bytes} [Thu Jun 30 13:18:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:18:48.456982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09912b59-bb40-45e6-9a00-4e33dd29ec59 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.457332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09912b59-bb40-45e6-9a00-4e33dd29ec59 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.457641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09912b59-bb40-45e6-9a00-4e33dd29ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.489474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-09912b59-bb40-45e6-9a00-4e33dd29ec59 None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:48.491833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-09912b59-bb40-45e6-9a00-4e33dd29ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:48.513696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:48.543578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:48.545043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:48.566609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 828/1652] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:18:48.570105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:48.585031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b6ff-0bb5-4a04-bd15-d6c4337f5223 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:48.603065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f54f0-1796-4a96-9891-062e2deed922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:48.604631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f54f0-1796-4a96-9891-062e2deed922 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.605084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f54f0-1796-4a96-9891-062e2deed922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.605669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f54f0-1796-4a96-9891-062e2deed922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.622559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f54f0-1796-4a96-9891-062e2deed922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:48.625915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f54f0-1796-4a96-9891-062e2deed922 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:48.654503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 825/1653] 10.222.0.47 () {58 vars in 1058 bytes} [Thu Jun 30 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:48.656074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23841c8b-2660-4a02-b49a-2316e357adbd None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.661654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23841c8b-2660-4a02-b49a-2316e357adbd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.661962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23841c8b-2660-4a02-b49a-2316e357adbd None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.663880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 829/1654] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:48.667695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 826/1655] 10.222.0.47 () {54 vars in 912 bytes} [Thu Jun 30 13:18:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:18:48.669338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ec7f-8c06-46b0-8b40-04b8801a074b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.670607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ec7f-8c06-46b0-8b40-04b8801a074b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.671065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ec7f-8c06-46b0-8b40-04b8801a074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.710425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8470ec7f-8c06-46b0-8b40-04b8801a074b None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:48.712311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8470ec7f-8c06-46b0-8b40-04b8801a074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:48.750923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 830/1656] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:18:48.845776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23841c8b-2660-4a02-b49a-2316e357adbd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:48.866407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23841c8b-2660-4a02-b49a-2316e357adbd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:48.875820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:48.876253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:48.876533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:48.876812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:48.902471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:48.906801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:48.922481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 827/1657] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:50.189504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ec7f-8c06-46b0-8b40-04b8801a074b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:50.204849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ec7f-8c06-46b0-8b40-04b8801a074b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:50.215218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae82f8-6eb6-4eed-a470-3dc1b27638e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:50.217903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae82f8-6eb6-4eed-a470-3dc1b27638e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:50.219338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae82f8-6eb6-4eed-a470-3dc1b27638e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:50.220846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae82f8-6eb6-4eed-a470-3dc1b27638e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:50.345023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae82f8-6eb6-4eed-a470-3dc1b27638e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:50.346649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae82f8-6eb6-4eed-a470-3dc1b27638e9 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:50.396899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 831/1658] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:51.571903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:51.750720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa6426-be23-49f4-b1e8-b6dccc87a1a1 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:51.765723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:51.767597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:51.767597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:51.767597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] PATH_INFO: `/v3/users/eb7f4d2ef2964c5f8d4adac2c8eecc1b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:51.768728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7f4d2ef2964c5f8d4adac2c8eecc1b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:51.770818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:51.889612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:51.899822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7f4d2ef2964c5f8d4adac2c8eecc1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:51.902004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7f4d2ef2964c5f8d4adac2c8eecc1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:51.927070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7f4d2ef2964c5f8d4adac2c8eecc1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:51.969041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7f4d2ef2964c5f8d4adac2c8eecc1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:51.969830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7f4d2ef2964c5f8d4adac2c8eecc1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:52.001643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 828/1659] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:18:51 2022] DELETE /identity/v3/users/eb7f4d2ef2964c5f8d4adac2c8eecc1b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:52.003440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:52.003967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:52.004182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:52.048291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:52.053853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:52.116232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:52.119347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:52.253408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 832/1660] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:52.263912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb41a8-0b39-4965-baed-2d43d2bff71e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:52.280393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:52.281909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:52.295074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:52.295984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:52.296274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:52.296552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] PATH_INFO: `/v3/users/528b973b7a73413482b088ed6ada4f3f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:52.299709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528b973b7a73413482b088ed6ada4f3f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:52.302931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:52.415549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6544-8679-458c-8967-5fcf1550fc31 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:52.420466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d0e71-2081-40cf-b3cb-7ffce939f848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:52.422035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0e71-2081-40cf-b3cb-7ffce939f848 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:52.422601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0e71-2081-40cf-b3cb-7ffce939f848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:52.422708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528b973b7a73413482b088ed6ada4f3f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:52.423135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0e71-2081-40cf-b3cb-7ffce939f848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:52.425823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528b973b7a73413482b088ed6ada4f3f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:52.444304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d0e71-2081-40cf-b3cb-7ffce939f848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:52.450961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d0e71-2081-40cf-b3cb-7ffce939f848 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:52.454541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528b973b7a73413482b088ed6ada4f3f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:52.477940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 833/1661] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:18:52.485990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528b973b7a73413482b088ed6ada4f3f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:52.488025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528b973b7a73413482b088ed6ada4f3f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:52.531790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 829/1662] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:18:52 2022] DELETE /identity/v3/users/528b973b7a73413482b088ed6ada4f3f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:52.536303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:52.536598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:52.536886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:52.554699 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:52.565498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:52.566821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:52.730323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 834/1663] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:52.771691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:52.775822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:52.927349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:52.959110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8ce7-0dd8-4be1-a234-9c1c2925fe15 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:52.991345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:52.992362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:52.994101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:52.994486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:53.025324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:53.034094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:53.089640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 830/1664] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:54.321787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:54.323238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:54.348295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7631f5-f4ae-4955-9785-a0eac7ac8700 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:54.360951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:54.361847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:54.362307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:54.362307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:54.362426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] PATH_INFO: `/v3/projects/3d90773633704c39944014a3cb7c7440` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:54.363744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d90773633704c39944014a3cb7c7440)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:54.364435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:54.365682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:54.394161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9479cb3-844b-4b34-9558-624aa55650f2 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:54.419252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:54.421351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:54.422986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:54.423462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] PATH_INFO: `/v3/projects/72a2cb47cea04a3dbbcfa022928c8c6a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:54.429428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a2cb47cea04a3dbbcfa022928c8c6a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:54.431357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:18:54.431357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: warnings.warn(msg) Jun 30 13:18:54.431357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: Jun 30 13:18:54.435447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:54.528859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d90773633704c39944014a3cb7c7440', 'request_id': 'req-d8f9b878-e02c-4b83-b287-5b29f713482f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.543188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d90773633704c39944014a3cb7c7440', 'request_id': 'req-d8f9b878-e02c-4b83-b287-5b29f713482f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.545957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a2cb47cea04a3dbbcfa022928c8c6a', 'request_id': 'req-1f41da3e-2220-417d-afc6-c799c3d1a548'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.557693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d90773633704c39944014a3cb7c7440', 'request_id': 'req-d8f9b878-e02c-4b83-b287-5b29f713482f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.588318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a2cb47cea04a3dbbcfa022928c8c6a', 'request_id': 'req-1f41da3e-2220-417d-afc6-c799c3d1a548'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.589091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] The token cache is being invalidate because project 3d90773633704c39944014a3cb7c7440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:18:54.589391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.590260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.593180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 835/1665] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:18:54 2022] DELETE /identity/v3/projects/3d90773633704c39944014a3cb7c7440 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:54.597152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:54.600534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:54.606614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a2cb47cea04a3dbbcfa022928c8c6a', 'request_id': 'req-1f41da3e-2220-417d-afc6-c799c3d1a548'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.649483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] The token cache is being invalidate because project 72a2cb47cea04a3dbbcfa022928c8c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:18:54.649887 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.650682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.655313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 831/1666] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:18:54 2022] DELETE /identity/v3/projects/72a2cb47cea04a3dbbcfa022928c8c6a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:54.656901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:54.666223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:54.731717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9b878-e02c-4b83-b287-5b29f713482f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:54.780085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:54.813566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41da3e-2220-417d-afc6-c799c3d1a548 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:54.830219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04136c14-c425-4238-89da-f89793844006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:54.830557 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:54.831536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136c14-c425-4238-89da-f89793844006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:54.831649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:54.831820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:54.832080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136c14-c425-4238-89da-f89793844006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:54.832198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] PATH_INFO: `/v3/users/825d9f488679412d9fa4c5771dbd5efb` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:54.832559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136c14-c425-4238-89da-f89793844006 admin admin] PATH_INFO: `/v3/users/0de8adb39c484e92a2e5eca03f8a166f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:54.833707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=825d9f488679412d9fa4c5771dbd5efb)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:54.834443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04136c14-c425-4238-89da-f89793844006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de8adb39c484e92a2e5eca03f8a166f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:54.834783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: WARNING py.warnings [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:18:54.834783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: warnings.warn(msg) Jun 30 13:18:54.834783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: Jun 30 13:18:54.836247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:54.836966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04136c14-c425-4238-89da-f89793844006 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:54.950681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825d9f488679412d9fa4c5771dbd5efb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.951337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825d9f488679412d9fa4c5771dbd5efb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.953436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04136c14-c425-4238-89da-f89793844006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de8adb39c484e92a2e5eca03f8a166f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.958445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04136c14-c425-4238-89da-f89793844006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de8adb39c484e92a2e5eca03f8a166f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.977318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04136c14-c425-4238-89da-f89793844006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de8adb39c484e92a2e5eca03f8a166f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.993516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:54.995662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04136c14-c425-4238-89da-f89793844006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de8adb39c484e92a2e5eca03f8a166f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:54.997609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04136c14-c425-4238-89da-f89793844006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de8adb39c484e92a2e5eca03f8a166f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:55.011604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825d9f488679412d9fa4c5771dbd5efb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:55.012477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825d9f488679412d9fa4c5771dbd5efb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:55.028394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 832/1667] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:18:54 2022] DELETE /identity/v3/users/0de8adb39c484e92a2e5eca03f8a166f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:55.028942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825d9f488679412d9fa4c5771dbd5efb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:55.058558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 836/1668] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:18:54 2022] DELETE /identity/v3/users/825d9f488679412d9fa4c5771dbd5efb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:55.897824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5b0c9-099b-4589-b07b-01dd4a677aea None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:55.899530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:55.900847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5b0c9-099b-4589-b07b-01dd4a677aea None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:55.902611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:55.902940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5b0c9-099b-4589-b07b-01dd4a677aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:55.972287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-18d5b0c9-099b-4589-b07b-01dd4a677aea None None] MFA Rules not processed for user `3ed225bee1dd41a6b5c2c38d785f2d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:55.976073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-18d5b0c9-099b-4589-b07b-01dd4a677aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:56.041105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7d9e-659a-4462-97fd-60ea5bbd4e0f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:56.053158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:56.054071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:56.054354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:56.055543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] PATH_INFO: `/v3/projects/ba1b7621bc9940e7895b1fd110a6f717` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:56.058224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1b7621bc9940e7895b1fd110a6f717)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:56.060316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:56.104075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 833/1669] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:56.135417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42553a-38fc-402b-94a4-16b7403ec385 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:56.142211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42553a-38fc-402b-94a4-16b7403ec385 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:56.142576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42553a-38fc-402b-94a4-16b7403ec385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:56.179688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ad42553a-38fc-402b-94a4-16b7403ec385 None None] MFA Rules not processed for user `3ed225bee1dd41a6b5c2c38d785f2d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:56.181963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ad42553a-38fc-402b-94a4-16b7403ec385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:56.187986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1b7621bc9940e7895b1fd110a6f717', 'request_id': 'req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.202507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1b7621bc9940e7895b1fd110a6f717', 'request_id': 'req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.211943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:56.223399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1b7621bc9940e7895b1fd110a6f717', 'request_id': 'req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.251084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] The token cache is being invalidate because project ba1b7621bc9940e7895b1fd110a6f717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:18:56.251379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.252053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.253797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 837/1670] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:18:55 2022] DELETE /identity/v3/projects/ba1b7621bc9940e7895b1fd110a6f717 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:56.259801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:56.269153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:56.359877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 834/1671] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:56.361452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:56.361826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:56.362166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:56.412077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:56.414026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:56.453844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec266-5cd4-4f93-b5ad-20872ec9e9d9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:56.465935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:56.467542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:56.470122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:56.471486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] PATH_INFO: `/v3/projects/6677c0a5a4de4434af41233b452a156e` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:56.474252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6677c0a5a4de4434af41233b452a156e)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:56.477406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:56.589880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 835/1672] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:56.591280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:56.596421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6677c0a5a4de4434af41233b452a156e', 'request_id': 'req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.596616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:56.621607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6677c0a5a4de4434af41233b452a156e', 'request_id': 'req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.650700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6677c0a5a4de4434af41233b452a156e', 'request_id': 'req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.673297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] The token cache is being invalidate because project 6677c0a5a4de4434af41233b452a156e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:18:56.674251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.679055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-442c10e9-231e-4ff6-b4c5-1a6c8ca3d03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:18:56.681568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 838/1673] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:18:56 2022] DELETE /identity/v3/projects/6677c0a5a4de4434af41233b452a156e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:56.684069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c904a4-0ede-4c6f-917a-eaa945248c84 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:56.684606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c904a4-0ede-4c6f-917a-eaa945248c84 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:56.684606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c904a4-0ede-4c6f-917a-eaa945248c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:56.686509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:56.720110 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b1c904a4-0ede-4c6f-917a-eaa945248c84 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:56.721954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b1c904a4-0ede-4c6f-917a-eaa945248c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:56.792029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d7dbd-7c55-46dc-8386-dbebc88bc087 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:56.930310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cfe00-417e-4fd9-a576-8f9ae90e6d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:56.931150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cfe00-417e-4fd9-a576-8f9ae90e6d09 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:56.931541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cfe00-417e-4fd9-a576-8f9ae90e6d09 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:56.932128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cfe00-417e-4fd9-a576-8f9ae90e6d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:56.934436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c96cfe00-417e-4fd9-a576-8f9ae90e6d09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:57.050518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cfe00-417e-4fd9-a576-8f9ae90e6d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.052306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cfe00-417e-4fd9-a576-8f9ae90e6d09 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.073595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 836/1674] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:57.074947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f203-fd23-4af7-8be0-3c5f71b50766 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.075201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f203-fd23-4af7-8be0-3c5f71b50766 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.075483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f203-fd23-4af7-8be0-3c5f71b50766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.124737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 839/1675] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:57.125847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c904a4-0ede-4c6f-917a-eaa945248c84 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.132460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d277f203-fd23-4af7-8be0-3c5f71b50766 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:57.134231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d277f203-fd23-4af7-8be0-3c5f71b50766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:57.139753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c904a4-0ede-4c6f-917a-eaa945248c84 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.156703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.157396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.157703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.157978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.159062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:57.159379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.159882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 837/1676] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:57.162446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.164127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d74a3-84e9-47e7-8b4e-89a1652064bc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.164447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d74a3-84e9-47e7-8b4e-89a1652064bc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.164726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d74a3-84e9-47e7-8b4e-89a1652064bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.182964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 840/1677] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:18:57.190501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.202998 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:57.203676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9e0d74a3-84e9-47e7-8b4e-89a1652064bc None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:57.204912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9e0d74a3-84e9-47e7-8b4e-89a1652064bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:57.210562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4167b-aac4-469c-8eb4-a410f6cacfd1 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.230999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 838/1678] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:57.232692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d74a3-84e9-47e7-8b4e-89a1652064bc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.233496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.234813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.234813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.234813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.235391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.237667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.259185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d74a3-84e9-47e7-8b4e-89a1652064bc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.270600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.271677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.271968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.272300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.273045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:18:57.273357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.277289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.302188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 841/1679] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:57 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:57.307728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 839/1680] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:18:57.308845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.311949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.327652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ac9a0-d523-49ce-a805-005a1f79890c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.419165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08980f-b212-4080-ac3c-d7a9f430e48b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.423749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:57.434097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.437146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.438939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.439325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.452394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.463995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.464671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.464957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.465236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.466009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.467316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.467934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.505369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 840/1681] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:57 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:18:57.510123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.516730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 842/1682] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:57 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:57.518580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.536797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d039a-1b0a-4343-ae4f-fb3ec2fd74ce admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.654539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.656760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.657321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.658393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.661818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.664471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.700553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 843/1683] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:57.704457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.722196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99578bd-451d-4380-af16-7ac572a99b3e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.726436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e903f5-02a9-4784-bc42-9dfc826cbaa6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.735636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.736714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.740073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.740466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.741125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.742053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.744655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.744793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.745164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.745767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.747051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.749431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.779843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 844/1684] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:57.784066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.810737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 841/1685] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:57 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:18:57.814939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.815521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dc3a1-48a9-4906-83e3-6b5b2b71f1db admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.831350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83c407-88d2-4971-bd45-861adf2de63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.832535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c407-88d2-4971-bd45-861adf2de63e admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.835579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c407-88d2-4971-bd45-861adf2de63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.836040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c407-88d2-4971-bd45-861adf2de63e admin admin] PATH_INFO: `/v3/projects/4e92cc4ed509482e9fc5e1798459e89a/users/3b2edd600e9d4a06b39f7f52ea502ea9/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.843794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12539774-6d35-464d-a870-daf58f9ce631 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.858995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:57.861088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.861999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.862408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:57.863268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.868357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.892621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c407-88d2-4971-bd45-861adf2de63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e92cc4ed509482e9fc5e1798459e89a, user_id=3b2edd600e9d4a06b39f7f52ea502ea9, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:57.900026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c407-88d2-4971-bd45-861adf2de63e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:57.900417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 842/1686] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:57.911022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:57.947415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 845/1687] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:57 2022] PUT /identity/v3/projects/4e92cc4ed509482e9fc5e1798459e89a/users/3b2edd600e9d4a06b39f7f52ea502ea9/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:18:57.958531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fe216-7343-4f87-a826-6c0649d9cb73 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:57.967078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6447eb8-8f5b-41ae-aa1d-249fffca2876 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:57.967394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6447eb8-8f5b-41ae-aa1d-249fffca2876 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:57.968766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6447eb8-8f5b-41ae-aa1d-249fffca2876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.060667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c6447eb8-8f5b-41ae-aa1d-249fffca2876 None None] MFA Rules not processed for user `3b2edd600e9d4a06b39f7f52ea502ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:58.066291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c6447eb8-8f5b-41ae-aa1d-249fffca2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:58.129583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0a20-2ad5-4cc8-b1a9-b8440f3af749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:58.133757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0a20-2ad5-4cc8-b1a9-b8440f3af749 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:58.133757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0a20-2ad5-4cc8-b1a9-b8440f3af749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:58.133757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0a20-2ad5-4cc8-b1a9-b8440f3af749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.134277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b0a20-2ad5-4cc8-b1a9-b8440f3af749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:58.138243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:58.147840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b0a20-2ad5-4cc8-b1a9-b8440f3af749 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:58.178135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 843/1688] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:58.179804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eccaf-39c0-4877-b873-3a3fc48518e4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:58.182670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eccaf-39c0-4877-b873-3a3fc48518e4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:58.184715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eccaf-39c0-4877-b873-3a3fc48518e4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.190924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 844/1689] 10.222.0.47 () {54 vars in 912 bytes} [Thu Jun 30 13:18:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:18:58.203974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eccaf-39c0-4877-b873-3a3fc48518e4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:58.267851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eccaf-39c0-4877-b873-3a3fc48518e4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:58.296235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:58.297451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:58.298105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:58.298237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] PATH_INFO: `/v3/projects/13ddf703fe4242e4b88f76eee1984ad8/users/65ee06bb6377481083de02ab181807db/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.298726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 846/1690] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:58.300537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f535f-8554-447b-afd1-e0a88b8baf76 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:58.301922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f535f-8554-447b-afd1-e0a88b8baf76 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:58.302528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f535f-8554-447b-afd1-e0a88b8baf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.409266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ddf703fe4242e4b88f76eee1984ad8, user_id=65ee06bb6377481083de02ab181807db, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:58.413063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:58.423179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c34f535f-8554-447b-afd1-e0a88b8baf76 None None] MFA Rules not processed for user `98a5a31ddbe04b2490689adcbe76f9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:58.424433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c34f535f-8554-447b-afd1-e0a88b8baf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:58.462392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 845/1691] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:58 2022] PUT /identity/v3/projects/13ddf703fe4242e4b88f76eee1984ad8/users/65ee06bb6377481083de02ab181807db/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:58.472812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:58.526536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:58.639611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 847/1692] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:18:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:58.641803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e4e6-10b8-4e3a-94e6-a2f086bb5984 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:58.643983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e4e6-10b8-4e3a-94e6-a2f086bb5984 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:58.650722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e4e6-10b8-4e3a-94e6-a2f086bb5984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.695558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130880-3dfd-45a9-bb98-40a4cf908e50 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:58.711261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:58.711944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:58.712224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:58.712498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.714397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:58.716323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:58.722341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7890e4e6-10b8-4e3a-94e6-a2f086bb5984 None None] MFA Rules not processed for user `65ee06bb6377481083de02ab181807db`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:58.723580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7890e4e6-10b8-4e3a-94e6-a2f086bb5984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:58.795863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 846/1693] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:58 2022] POST /identity/v3/projects => generated 363 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:58.800434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:58.803088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:58.896779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 848/1694] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:58.896779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e4e6-10b8-4e3a-94e6-a2f086bb5984 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:58.915266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e4e6-10b8-4e3a-94e6-a2f086bb5984 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:58.940233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912601-760b-4e06-bf8b-517c5140a01a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:58.950585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:58.951286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:58.951621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:58.951907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:58.961040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:58.963272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:58.973991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 847/1695] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:18:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:18:58.974996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.072421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:59.082019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19ca2-9a66-4eff-a835-c45fc76c0e7b service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:59.089046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.089784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.090069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.090350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.091099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.094683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.103367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.104190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.104558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.104900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.105725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.107734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.158417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 848/1696] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:18:58 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:59.160421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.175359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 849/1697] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:58 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:59.178876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.209017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7013b1-07cd-4819-b896-2c79943bcdbf admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:59.226373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:59.330217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a01d4-b0a8-44b5-a0ac-601286ee39f6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:59.344166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.345153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7935a5-fe7f-415f-ac09-2fd228cac1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.345291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.346561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.346856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.347618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.349642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.349995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7935a5-fe7f-415f-ac09-2fd228cac1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.362330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7935a5-fe7f-415f-ac09-2fd228cac1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.362811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7935a5-fe7f-415f-ac09-2fd228cac1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.363702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7935a5-fe7f-415f-ac09-2fd228cac1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.365431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7935a5-fe7f-415f-ac09-2fd228cac1ed admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.398665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 850/1698] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:59.401434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c121dc-1340-422a-863c-eb305affb935 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.401766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c121dc-1340-422a-863c-eb305affb935 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.402054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c121dc-1340-422a-863c-eb305affb935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.404707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 849/1699] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:18:59 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:18:59.408572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.435678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48492cb0-a9e9-4c7a-8eb4-42614501440c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:59.455779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.456699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.456988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.459470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] PATH_INFO: `/v3/projects/4ffea879e3cc4b598c9468b5df637bd9/users/7d775ab45d5a4e6c8082fa46487ba9c6/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.499925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-62c121dc-1340-422a-863c-eb305affb935 None None] MFA Rules not processed for user `640e3ad3e6174e8e86333ae5c1a907ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:59.501505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-62c121dc-1340-422a-863c-eb305affb935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:18:59.524967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffea879e3cc4b598c9468b5df637bd9, user_id=7d775ab45d5a4e6c8082fa46487ba9c6, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.527728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.568187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 850/1700] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:59 2022] PUT /identity/v3/projects/4ffea879e3cc4b598c9468b5df637bd9/users/7d775ab45d5a4e6c8082fa46487ba9c6/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:59.569041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.715060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 851/1701] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:18:59.715931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c121dc-1340-422a-863c-eb305affb935 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.753767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c121dc-1340-422a-863c-eb305affb935 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:59.765303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784218-155a-48ee-a014-3716ec8e84f3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:59.774492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372c957-5481-4005-ae79-6a5a9d251328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.775340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372c957-5481-4005-ae79-6a5a9d251328 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.775634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372c957-5481-4005-ae79-6a5a9d251328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.775909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372c957-5481-4005-ae79-6a5a9d251328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.776648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372c957-5481-4005-ae79-6a5a9d251328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.783920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372c957-5481-4005-ae79-6a5a9d251328 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.787425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.788117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.788404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.788681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.789471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.794605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.817708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 852/1702] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:59.820410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd68d1-5281-4477-b461-ec2ef53b8d41 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.821270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd68d1-5281-4477-b461-ec2ef53b8d41 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.821575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd68d1-5281-4477-b461-ec2ef53b8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.828629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 851/1703] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:18:59.839094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.864776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b607d3-578e-483e-816c-9013dec8ed2c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:18:59.877111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:18:59.877278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:18:59.877948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:18:59.878223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] PATH_INFO: `/v3/projects/4ffea879e3cc4b598c9468b5df637bd9/users/7d775ab45d5a4e6c8082fa46487ba9c6/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:18:59.881337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffea879e3cc4b598c9468b5df637bd9, user_id=7d775ab45d5a4e6c8082fa46487ba9c6, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:18:59.886429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:18:59.912706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 852/1704] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:59 2022] PUT /identity/v3/projects/4ffea879e3cc4b598c9468b5df637bd9/users/7d775ab45d5a4e6c8082fa46487ba9c6/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:18:59.916197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-54dd68d1-5281-4477-b461-ec2ef53b8d41 None None] MFA Rules not processed for user `640e3ad3e6174e8e86333ae5c1a907ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:18:59.916462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:18:59.917443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-54dd68d1-5281-4477-b461-ec2ef53b8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:00.127333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:00.157698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 853/1705] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:00.159104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a57c-ff7d-4ece-83ea-11816dc269ab None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.159390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a57c-ff7d-4ece-83ea-11816dc269ab None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.159665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a57c-ff7d-4ece-83ea-11816dc269ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.169667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6af57-aef1-4c93-8945-0d8fcde4e972 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:00.249694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94f8e-9fda-48f4-a155-93e8523f7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:00.251046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94f8e-9fda-48f4-a155-93e8523f7058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.251493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94f8e-9fda-48f4-a155-93e8523f7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.251885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94f8e-9fda-48f4-a155-93e8523f7058 admin admin] PATH_INFO: `/v3/projects/042b2174874f4c079943e39937a465fa/users/8a85ba8fe76a4076837d5ad679ee1f10/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.252845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a9f3a57c-ff7d-4ece-83ea-11816dc269ab None None] MFA Rules not processed for user `7d775ab45d5a4e6c8082fa46487ba9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:00.254589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a9f3a57c-ff7d-4ece-83ea-11816dc269ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:00.304393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:00.311422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94f8e-9fda-48f4-a155-93e8523f7058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042b2174874f4c079943e39937a465fa, user_id=8a85ba8fe76a4076837d5ad679ee1f10, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:00.314822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94f8e-9fda-48f4-a155-93e8523f7058 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:00.351490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 853/1706] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:18:59 2022] PUT /identity/v3/projects/042b2174874f4c079943e39937a465fa/users/8a85ba8fe76a4076837d5ad679ee1f10/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:00.355947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c339-8d1e-4b01-aa3a-463a93fb7745 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.356724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c339-8d1e-4b01-aa3a-463a93fb7745 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.357831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c339-8d1e-4b01-aa3a-463a93fb7745 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.366014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 854/1707] 10.222.0.47 () {54 vars in 960 bytes} [Thu Jun 30 13:19:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:19:00.368541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c339-8d1e-4b01-aa3a-463a93fb7745 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:00.435624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 854/1708] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:00.437985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.438465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.438820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.493849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c339-8d1e-4b01-aa3a-463a93fb7745 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:00.495377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:00.498017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:00.498755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:00.500558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.500850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.501127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.501921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:00.503980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:00.521526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 855/1709] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:00.522500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:00.532763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:00.625949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 855/1710] 10.222.0.47 () {58 vars in 1057 bytes} [Thu Jun 30 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:00.627060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:00.629543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:00.633200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6462-16f3-4ed5-a5e0-92f821964150 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:00.639829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:00.640497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.640785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.641250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.710849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:00.713006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:00.723626 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 856/1711] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:00.724567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:00.733669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c9998-c27e-4e17-9871-93f1ba56228a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:00.738029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:00.738802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.739191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.739570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.741344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453bf9-b859-46c5-88ad-661f3241d397 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:00.748035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed68778-c1f7-4e52-9535-1895cb0d6277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:00.748944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed68778-c1f7-4e52-9535-1895cb0d6277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.749230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed68778-c1f7-4e52-9535-1895cb0d6277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.749533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed68778-c1f7-4e52-9535-1895cb0d6277 admin admin] PATH_INFO: `/v3/projects/042b2174874f4c079943e39937a465fa/users/8a85ba8fe76a4076837d5ad679ee1f10/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.751704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed68778-c1f7-4e52-9535-1895cb0d6277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042b2174874f4c079943e39937a465fa, user_id=8a85ba8fe76a4076837d5ad679ee1f10, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:00.755509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed68778-c1f7-4e52-9535-1895cb0d6277 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:00.777289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 857/1712] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:00 2022] PUT /identity/v3/projects/042b2174874f4c079943e39937a465fa/users/8a85ba8fe76a4076837d5ad679ee1f10/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:00.778962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44951868-20d4-4548-934e-2b3ea72857b4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:00.779257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44951868-20d4-4548-934e-2b3ea72857b4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:00.779539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44951868-20d4-4548-934e-2b3ea72857b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:00.803199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:00.810670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:00.820018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-44951868-20d4-4548-934e-2b3ea72857b4 None None] MFA Rules not processed for user `0281a2bde51542e6af4ad2a23befe12b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:00.822112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-44951868-20d4-4548-934e-2b3ea72857b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:00.850613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:00.854299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:00.888579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 856/1713] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:00 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:00.889774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:00.892354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:00.938552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce1b5-fb71-46d4-a7ae-134557e432b9 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:01.094853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 858/1714] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:01.095650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44951868-20d4-4548-934e-2b3ea72857b4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:01.142345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:01.143251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:01.143532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:01.143810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] PATH_INFO: `/v3/users/bcbee88914f340cf8fa774b0049fe45d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:01.152629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbee88914f340cf8fa774b0049fe45d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:01.155288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:01.294703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44951868-20d4-4548-934e-2b3ea72857b4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:01.295697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbee88914f340cf8fa774b0049fe45d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:01.296516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbee88914f340cf8fa774b0049fe45d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:01.309665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534683a0-9c67-46ce-8abb-d11cd8573f97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:01.310308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534683a0-9c67-46ce-8abb-d11cd8573f97 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:01.310591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534683a0-9c67-46ce-8abb-d11cd8573f97 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:01.310864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534683a0-9c67-46ce-8abb-d11cd8573f97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:01.314105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-534683a0-9c67-46ce-8abb-d11cd8573f97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.345452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbee88914f340cf8fa774b0049fe45d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:01.346254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbee88914f340cf8fa774b0049fe45d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:01.354335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534683a0-9c67-46ce-8abb-d11cd8573f97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:01.356205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534683a0-9c67-46ce-8abb-d11cd8573f97 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:01.367475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbee88914f340cf8fa774b0049fe45d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:01.367879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 859/1715] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:01.369191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:01.369685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:01.369964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:01.390939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 857/1716] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:00 2022] DELETE /identity/v3/users/bcbee88914f340cf8fa774b0049fe45d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:01.392230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:01.404151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.425420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] MFA Rules not processed for user `8a85ba8fe76a4076837d5ad679ee1f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:01.427146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.487293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:01.487882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c41f00-0eed-4ef6-8531-ca8202797110 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:01.503635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f53c7-792f-4b56-8afd-efa26fcceee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:01.504819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f53c7-792f-4b56-8afd-efa26fcceee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:01.505276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f53c7-792f-4b56-8afd-efa26fcceee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:01.506058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f53c7-792f-4b56-8afd-efa26fcceee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:01.509399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-417f53c7-792f-4b56-8afd-efa26fcceee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.635385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f53c7-792f-4b56-8afd-efa26fcceee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:01.637641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f53c7-792f-4b56-8afd-efa26fcceee3 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:01.640549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 860/1717] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:01.642710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:01.650775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.651319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 858/1718] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:01.652707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:01.652994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:01.653320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:01.679694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:01.680982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.715246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:01.846632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f06b5-189e-40e4-89ed-966789ddf229 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:01.861354 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:01.862206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:01.863042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:01.863042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:01.864691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.868443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 859/1719] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:01.871585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:01.878718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:01.915208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512d74-f3c7-4cd1-982d-46d98a92542e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:01.925783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:01.926614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:01.926988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:01.927400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:01.957229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:01.959161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:01.985975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 860/1720] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:01.986709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:01.992932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:02.006224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:02.008846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:02.051287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 861/1721] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:02.109309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:02.122773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625038db-6937-4764-8fe3-46f270e3491c service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:02.130577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12effbd-be7c-4b93-87ec-fbd082263ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:02.131408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12effbd-be7c-4b93-87ec-fbd082263ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:02.131699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12effbd-be7c-4b93-87ec-fbd082263ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:02.135740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12effbd-be7c-4b93-87ec-fbd082263ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:02.140884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d12effbd-be7c-4b93-87ec-fbd082263ab1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:02.202793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e29342-ab07-45e9-a162-7f733b9594f1 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:02.216739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:02.217547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:02.218057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:02.218400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:02.241391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:02.243568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:02.272632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 861/1722] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:02.291902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12effbd-be7c-4b93-87ec-fbd082263ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:02.297093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12effbd-be7c-4b93-87ec-fbd082263ab1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:02.320467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 862/1723] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:02.605903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:02.607372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:02.636000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7ac4-0098-45bd-84e1-e7f4d4fe7e2b service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:02.657824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:02.658749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:02.659027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:02.659301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] PATH_INFO: `/v3/users/3b2edd600e9d4a06b39f7f52ea502ea9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:02.662205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2edd600e9d4a06b39f7f52ea502ea9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:02.664203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:02.779670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:02.843362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2edd600e9d4a06b39f7f52ea502ea9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:02.858052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2edd600e9d4a06b39f7f52ea502ea9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:02.883104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2edd600e9d4a06b39f7f52ea502ea9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:02.884773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2edd600e9d4a06b39f7f52ea502ea9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:02.898234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4d639cba-b343-4bfc-8019-35643dac995e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2edd600e9d4a06b39f7f52ea502ea9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:02.921708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 862/1724] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:02 2022] DELETE /identity/v3/users/3b2edd600e9d4a06b39f7f52ea502ea9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:02.938996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:02.939291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:02.939580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:02.945094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:02.946840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:02.947158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:02.971498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:02.973949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:03.008793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] MFA Rules not processed for user `640e3ad3e6174e8e86333ae5c1a907ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:03.011374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:03.090417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:03.150205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 863/1725] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:03.151729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:03.155090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:03.188994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 863/1726] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:03.386450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8922b-39a1-4900-98b3-5abaf1505521 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:03.401155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6547e-20ad-4a40-b1d5-f24455b70738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:03.405765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6547e-20ad-4a40-b1d5-f24455b70738 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:03.407789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6547e-20ad-4a40-b1d5-f24455b70738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:03.409668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6547e-20ad-4a40-b1d5-f24455b70738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:03.434510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6547e-20ad-4a40-b1d5-f24455b70738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:03.436346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6547e-20ad-4a40-b1d5-f24455b70738 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:03.468640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 864/1727] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:03.633973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:03.635637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:03.671218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfa7ce-019c-4a4a-b425-0f056c9250d6 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:03.693508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:03.700145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:03.700576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:03.701246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] PATH_INFO: `/v3/users/65ee06bb6377481083de02ab181807db` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:03.706342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ee06bb6377481083de02ab181807db)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:03.709207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:03.902882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ee06bb6377481083de02ab181807db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:03.905907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ee06bb6377481083de02ab181807db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:03.958366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ee06bb6377481083de02ab181807db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:03.965119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ee06bb6377481083de02ab181807db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:03.997943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ee06bb6377481083de02ab181807db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:04.033733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 864/1728] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:03 2022] DELETE /identity/v3/users/65ee06bb6377481083de02ab181807db => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:04.038125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e41f5-8d67-4911-8d0f-ba5d4f6927c4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:04.038554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e41f5-8d67-4911-8d0f-ba5d4f6927c4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:04.038936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e41f5-8d67-4911-8d0f-ba5d4f6927c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:04.106571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-983e41f5-8d67-4911-8d0f-ba5d4f6927c4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:04.113158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-983e41f5-8d67-4911-8d0f-ba5d4f6927c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:04.382165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 865/1729] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:04.440612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:04.442277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:04.454855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed2aa-58ef-4e48-b2ca-25c9e09758d7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:04.455337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed2aa-58ef-4e48-b2ca-25c9e09758d7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:04.455409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed2aa-58ef-4e48-b2ca-25c9e09758d7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:04.457200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 866/1730] 10.222.0.47 () {54 vars in 912 bytes} [Thu Jun 30 13:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:19:04.464705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:04.464998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:04.465283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:04.571958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] MFA Rules not processed for user `98a5a31ddbe04b2490689adcbe76f9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:04.582246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:04.589197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:04.752895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a897e6-1533-415a-9320-1c1e7e38c966 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:04.781605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:04.782292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:04.782577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:04.782877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:04.823513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:04.825079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:04.849708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 867/1731] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:04.850955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:04.858064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:04.877439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 865/1732] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:04.888047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06726533-f08b-4ca1-9298-a60c3484e1ed None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:04.893427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:04.897845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:04.917481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:04.918609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:04.919053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:04.919397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] PATH_INFO: `/v3/projects/f532809dd47346688a31a07ae1352dc4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:04.924203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f532809dd47346688a31a07ae1352dc4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:04.926261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:04.944511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e6222-b0b5-45f2-9752-efca6fd3fac9 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:04.960252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:04.961180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:04.961511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:04.961905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] PATH_INFO: `/v3/projects/4e92cc4ed509482e9fc5e1798459e89a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:04.964276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e92cc4ed509482e9fc5e1798459e89a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:04.970821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:05.010235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:05.025439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f532809dd47346688a31a07ae1352dc4', 'request_id': 'req-87f6a54f-54fb-440c-8176-e08bfa855bbb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.040415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f532809dd47346688a31a07ae1352dc4', 'request_id': 'req-87f6a54f-54fb-440c-8176-e08bfa855bbb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.051738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f532809dd47346688a31a07ae1352dc4', 'request_id': 'req-87f6a54f-54fb-440c-8176-e08bfa855bbb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.072340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] The token cache is being invalidate because project f532809dd47346688a31a07ae1352dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:05.072633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.074541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.076531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 868/1733] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:04 2022] DELETE /identity/v3/projects/f532809dd47346688a31a07ae1352dc4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:05.077352 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:05.078919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:05.115257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e92cc4ed509482e9fc5e1798459e89a', 'request_id': 'req-34dbaf1b-a586-46b0-af4a-c030618a9d71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.123745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e92cc4ed509482e9fc5e1798459e89a', 'request_id': 'req-34dbaf1b-a586-46b0-af4a-c030618a9d71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.141510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e92cc4ed509482e9fc5e1798459e89a', 'request_id': 'req-34dbaf1b-a586-46b0-af4a-c030618a9d71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.187354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] The token cache is being invalidate because project 4e92cc4ed509482e9fc5e1798459e89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:05.187663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.193270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-34dbaf1b-a586-46b0-af4a-c030618a9d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.197094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 866/1734] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:04 2022] DELETE /identity/v3/projects/4e92cc4ed509482e9fc5e1798459e89a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:05.202369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc306c24-e364-442f-b3ab-a2733d80ec67 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:05.202651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc306c24-e364-442f-b3ab-a2733d80ec67 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:05.208393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc306c24-e364-442f-b3ab-a2733d80ec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:05.243319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-cc306c24-e364-442f-b3ab-a2733d80ec67 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:05.245649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-cc306c24-e364-442f-b3ab-a2733d80ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:05.256793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6a54f-54fb-440c-8176-e08bfa855bbb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:05.339561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:05.343279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:05.343780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:05.344300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:05.346902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:05.364312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:05.366509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:05.379712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 869/1735] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:05.380791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:05.382477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:05.455036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 867/1736] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:05.464855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12fc41-e523-4e94-95f9-fdb9f0766ddc service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:05.473190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366a20-0eb8-45f0-adec-8c9d0b74ea39 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:05.473524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366a20-0eb8-45f0-adec-8c9d0b74ea39 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:05.473784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366a20-0eb8-45f0-adec-8c9d0b74ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:05.479024 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:05.480003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:05.480380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:05.480667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] PATH_INFO: `/v3/users/7d775ab45d5a4e6c8082fa46487ba9c6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:05.482792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d775ab45d5a4e6c8082fa46487ba9c6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:05.486692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:05.505857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ec366a20-0eb8-45f0-adec-8c9d0b74ea39 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:05.507546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ec366a20-0eb8-45f0-adec-8c9d0b74ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:05.526109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 868/1737] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:05.528206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec366a20-0eb8-45f0-adec-8c9d0b74ea39 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:05.540273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec366a20-0eb8-45f0-adec-8c9d0b74ea39 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:05.553757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:05.555410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:05.555971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:05.556955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:05.557880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:05.558338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:05.558788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:05.561641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:05.579927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 869/1738] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:05.585377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:05.602673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d775ab45d5a4e6c8082fa46487ba9c6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.603785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d775ab45d5a4e6c8082fa46487ba9c6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.615188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e8f3d-0824-429c-bb58-41b699b351c3 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:05.620399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d775ab45d5a4e6c8082fa46487ba9c6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.632389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d630a-e113-4782-bc33-cf48dd54205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:05.633789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d630a-e113-4782-bc33-cf48dd54205a admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:05.644609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d630a-e113-4782-bc33-cf48dd54205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:05.645045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d630a-e113-4782-bc33-cf48dd54205a admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:05.647849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d630a-e113-4782-bc33-cf48dd54205a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:05.647987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d775ab45d5a4e6c8082fa46487ba9c6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.649499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d775ab45d5a4e6c8082fa46487ba9c6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:05.655324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d630a-e113-4782-bc33-cf48dd54205a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:05.687280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 870/1739] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:05 2022] DELETE /identity/v3/users/7d775ab45d5a4e6c8082fa46487ba9c6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:05.742214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 870/1740] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:05 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:05.743980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:05.745512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:05.915335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9363d25-227f-4f9d-8f11-3ec94b199ee3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:06.006566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166adae-31ee-4c49-99e1-9261872fd63c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:06.007071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166adae-31ee-4c49-99e1-9261872fd63c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:06.007482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166adae-31ee-4c49-99e1-9261872fd63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:06.031161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:06.071790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9166adae-31ee-4c49-99e1-9261872fd63c None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:06.074425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9166adae-31ee-4c49-99e1-9261872fd63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:06.158649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:06.161964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:06.162903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:06.163751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:06.166310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:06.173134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:06.222128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 871/1741] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:05 2022] POST /identity/v3/users => generated 290 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:06.226837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:06.251618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd13b74-b2dd-4e93-986b-16d6e90ec930 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:06.279527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:06.280234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:06.280520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:06.280794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:06.281900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:06.285130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:06.318973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 872/1742] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:06.321185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:06.326127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 871/1743] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:06.344878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ac218-cb8c-4cc7-8316-4d8c925803a5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:06.360741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0b24e-2de6-46e9-8d84-cf5660009a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:06.363165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0b24e-2de6-46e9-8d84-cf5660009a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:06.364914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0b24e-2de6-46e9-8d84-cf5660009a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:06.365956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0b24e-2de6-46e9-8d84-cf5660009a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:06.368403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0b24e-2de6-46e9-8d84-cf5660009a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:06.373341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0b24e-2de6-46e9-8d84-cf5660009a0f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:06.419026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 873/1744] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:06.420360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166adae-31ee-4c49-99e1-9261872fd63c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:06.443202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166adae-31ee-4c49-99e1-9261872fd63c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:06.474441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:06.475368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:06.475653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:06.475945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] PATH_INFO: `/v3/projects/ed93b90e93094bedb26d487cef8f5a03/users/ad2854afc58c44358332092a345c8b08/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:06.505046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed93b90e93094bedb26d487cef8f5a03, user_id=ad2854afc58c44358332092a345c8b08, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:06.508517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:06.540764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 872/1745] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:06 2022] PUT /identity/v3/projects/ed93b90e93094bedb26d487cef8f5a03/users/ad2854afc58c44358332092a345c8b08/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:06.550625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff6a6-a2af-41c8-ab75-d8d124fd9503 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:06.551152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff6a6-a2af-41c8-ab75-d8d124fd9503 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:06.551152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff6a6-a2af-41c8-ab75-d8d124fd9503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:06.604791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-150ff6a6-a2af-41c8-ab75-d8d124fd9503 None None] MFA Rules not processed for user `ad2854afc58c44358332092a345c8b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:06.606544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-150ff6a6-a2af-41c8-ab75-d8d124fd9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:06.644825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:06.667140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:06.669186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:06.888073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 874/1746] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:06.892488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff6a6-a2af-41c8-ab75-d8d124fd9503 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:06.905552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ea585-57ed-4eb0-8212-0aef2a8c44f5 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:06.961658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:06.965746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:06.967266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:06.969377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:07.097220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:07.098955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:07.112631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 873/1747] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 13:19:07.113737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:07.115318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:07.179088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:07.276366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff6a6-a2af-41c8-ab75-d8d124fd9503 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:07.297907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:07.298613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:07.298891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:07.309848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:07.311625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:07.318038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:07.374081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57353337-663c-4b8c-aed7-95e2d8cb3789 service swift] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:07.396467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 875/1748] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:06 2022] POST /identity/v3/projects => generated 381 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:07.397684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:07.400043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:07.401008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:07.401259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:07.401618 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] PATH_INFO: `/v3/users/2ff9fc7740a4445bbffb513ec7b8f00d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:07.401923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:07.413730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff9fc7740a4445bbffb513ec7b8f00d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:07.425518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:07.562214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437230-8888-4eed-9131-4095c4f3a94f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:07.588045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:07.588951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:07.592210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:07.592542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] PATH_INFO: `/v3/projects/13ddf703fe4242e4b88f76eee1984ad8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:07.600814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ddf703fe4242e4b88f76eee1984ad8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:07.609915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:07.621432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff9fc7740a4445bbffb513ec7b8f00d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.623682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff9fc7740a4445bbffb513ec7b8f00d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.689762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff9fc7740a4445bbffb513ec7b8f00d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.697257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff9fc7740a4445bbffb513ec7b8f00d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.738302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff9fc7740a4445bbffb513ec7b8f00d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.740621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:07.780322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ddf703fe4242e4b88f76eee1984ad8', 'request_id': 'req-3b47a95e-f553-45c2-b911-ef182cf15b41'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.801989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ddf703fe4242e4b88f76eee1984ad8', 'request_id': 'req-3b47a95e-f553-45c2-b911-ef182cf15b41'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.816457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 874/1749] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:07 2022] DELETE /identity/v3/users/2ff9fc7740a4445bbffb513ec7b8f00d => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:07.818976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ddf703fe4242e4b88f76eee1984ad8', 'request_id': 'req-3b47a95e-f553-45c2-b911-ef182cf15b41'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.821243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:07.826767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:07.852935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] The token cache is being invalidate because project 13ddf703fe4242e4b88f76eee1984ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:07.860433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.860433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:07.863963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 876/1750] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:07 2022] DELETE /identity/v3/projects/13ddf703fe4242e4b88f76eee1984ad8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:07.863963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:07.866720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:08.067669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47a95e-f553-45c2-b911-ef182cf15b41 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:08.073891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acad0a-46eb-45a2-8970-4aa0282fc6ff admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:08.081353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:08.081753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b47a94-f2f7-45c0-82d1-a534e31c555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:08.082555 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:08.082791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:08.083351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] PATH_INFO: `/v3/users/31682617bbf342f982f111f44deac3b7` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:08.084058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b47a94-f2f7-45c0-82d1-a534e31c555a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:08.084351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b47a94-f2f7-45c0-82d1-a534e31c555a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:08.084634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b47a94-f2f7-45c0-82d1-a534e31c555a admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:08.086845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=31682617bbf342f982f111f44deac3b7)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:08.086975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b47a94-f2f7-45c0-82d1-a534e31c555a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:08.089706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:08.092797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b47a94-f2f7-45c0-82d1-a534e31c555a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:08.144412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 877/1751] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:07 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:08.146817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:08.147147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:08.149561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:08.218224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:08.223225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:08.254808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 878/1752] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:08.255763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:08.257768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31682617bbf342f982f111f44deac3b7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.259380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:08.260651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31682617bbf342f982f111f44deac3b7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.266045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:08.297427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab2626-05d2-4936-845e-50bd0dbcb1a5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:08.299851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31682617bbf342f982f111f44deac3b7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.301750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31682617bbf342f982f111f44deac3b7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.312987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:08.314461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:08.315590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:08.315985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] PATH_INFO: `/v3/users/8a85ba8fe76a4076837d5ad679ee1f10` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:08.319006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31682617bbf342f982f111f44deac3b7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.325818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a85ba8fe76a4076837d5ad679ee1f10)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:08.330160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:08.370499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 875/1753] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:07 2022] DELETE /identity/v3/users/31682617bbf342f982f111f44deac3b7 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:08.378666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:08.380955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:08.483286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a85ba8fe76a4076837d5ad679ee1f10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.484788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a85ba8fe76a4076837d5ad679ee1f10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.499510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a85ba8fe76a4076837d5ad679ee1f10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.526942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a85ba8fe76a4076837d5ad679ee1f10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.532823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a85ba8fe76a4076837d5ad679ee1f10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:08.577732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 879/1754] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:08 2022] DELETE /identity/v3/users/8a85ba8fe76a4076837d5ad679ee1f10 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:08.579428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:08.581156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:08.640145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:08.670688 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8da05b-7f71-412c-bfb8-8d4c174e07ee admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:08.718748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8217f-790b-43c4-a9f2-d56e1e867b76 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:08.730333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613a8d6-81f7-456e-90f2-3bdb9105c268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:08.731898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a8d6-81f7-456e-90f2-3bdb9105c268 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:08.733404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a8d6-81f7-456e-90f2-3bdb9105c268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:08.735779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a8d6-81f7-456e-90f2-3bdb9105c268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:08.740502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1613a8d6-81f7-456e-90f2-3bdb9105c268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:08.911279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613a8d6-81f7-456e-90f2-3bdb9105c268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:08.916401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613a8d6-81f7-456e-90f2-3bdb9105c268 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:08.945839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 880/1755] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:08.946538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:08.947232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:08.947525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:08.947814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:08.950247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:08.951163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:08.951617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:08.951916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:08.961763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:08.992194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 876/1756] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 621 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:08.996897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:08.999722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:09.001038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:09.011294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:09.020902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 881/1757] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:09.055090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af814-0e6b-4bfd-a2b2-24a494bb4f2c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:09.060780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:09.062001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:09.062455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:09.062875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] PATH_INFO: `/v3/projects/44aa0db193e646d2be0b6aba6560d2e4/users/7706af9135434aa4bcc3ab895e14f178/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:09.085757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aa0db193e646d2be0b6aba6560d2e4, user_id=7706af9135434aa4bcc3ab895e14f178, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:09.090018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:09.091643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:09.095962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:09.110615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 877/1758] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:08 2022] PUT /identity/v3/projects/44aa0db193e646d2be0b6aba6560d2e4/users/7706af9135434aa4bcc3ab895e14f178/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:09.123091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:09.163127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7982d-e6d7-4902-a891-30b42dc4ffab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:09.204919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:09.240474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4d0f4-bbfb-460c-874d-6664802a7033 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:09.249764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:09.250613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:09.250990 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:09.251836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:09.252807 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:09.254528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:09.267770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 878/1759] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:09.271675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:09.291896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ade362-a87a-428a-8782-c4c51fe72e3b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:09.307532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01debe-79d2-4f84-a004-9e0889600bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:09.308595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01debe-79d2-4f84-a004-9e0889600bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:09.308973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01debe-79d2-4f84-a004-9e0889600bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:09.309406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01debe-79d2-4f84-a004-9e0889600bce admin admin] PATH_INFO: `/v3/projects/44aa0db193e646d2be0b6aba6560d2e4/users/7706af9135434aa4bcc3ab895e14f178/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:09.312551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01debe-79d2-4f84-a004-9e0889600bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aa0db193e646d2be0b6aba6560d2e4, user_id=7706af9135434aa4bcc3ab895e14f178, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:09.319026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01debe-79d2-4f84-a004-9e0889600bce admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:09.328115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:09.328984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:09.329288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:09.329630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:09.354225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:09.356169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:09.373254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 879/1760] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:09 2022] PUT /identity/v3/projects/44aa0db193e646d2be0b6aba6560d2e4/users/7706af9135434aa4bcc3ab895e14f178/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:09.385934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263faad-0ac7-401f-8662-d807a626670e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:09.385934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263faad-0ac7-401f-8662-d807a626670e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:09.389748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 882/1761] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:09.391487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263faad-0ac7-401f-8662-d807a626670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:09.501049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4263faad-0ac7-401f-8662-d807a626670e None None] MFA Rules not processed for user `7706af9135434aa4bcc3ab895e14f178`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:09.516277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4263faad-0ac7-401f-8662-d807a626670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:09.752376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 880/1762] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:09.765346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:09.767710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:09.924467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263faad-0ac7-401f-8662-d807a626670e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:09.926921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4263faad-0ac7-401f-8662-d807a626670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:09.990629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fa0a0-42d6-4ee2-a015-66e7f02ce12a service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:10.067445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:10.159366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:10.161846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:10.163716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:10.164798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:10.194640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:10.196615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:10.223534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 883/1763] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:19:10.354754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263faad-0ac7-401f-8662-d807a626670e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:10.371898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:10.381396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daae01-b77f-489c-951b-5eb594be394f service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:10.388733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:10.395096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:10.395414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:10.395704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] PATH_INFO: `/v3/projects/4ffea879e3cc4b598c9468b5df637bd9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:10.395879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d540fd3-d76f-4eee-8ebf-b0c03406ea30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:10.396508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d540fd3-d76f-4eee-8ebf-b0c03406ea30 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:10.396820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d540fd3-d76f-4eee-8ebf-b0c03406ea30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:10.398293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d540fd3-d76f-4eee-8ebf-b0c03406ea30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:10.402428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffea879e3cc4b598c9468b5df637bd9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:10.408910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8d540fd3-d76f-4eee-8ebf-b0c03406ea30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:10.411437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:10.566103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffea879e3cc4b598c9468b5df637bd9', 'request_id': 'req-6ca88efb-d268-4dad-a5e0-cff319c95f73'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:10.590682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffea879e3cc4b598c9468b5df637bd9', 'request_id': 'req-6ca88efb-d268-4dad-a5e0-cff319c95f73'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:10.598995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:10.612647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffea879e3cc4b598c9468b5df637bd9', 'request_id': 'req-6ca88efb-d268-4dad-a5e0-cff319c95f73'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:10.638458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] The token cache is being invalidate because project 4ffea879e3cc4b598c9468b5df637bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:10.639668 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:10.641647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6ca88efb-d268-4dad-a5e0-cff319c95f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:10.650428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 881/1764] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:09 2022] DELETE /identity/v3/projects/4ffea879e3cc4b598c9468b5df637bd9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:10.654853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1385-2977-464f-a505-552673c6a43f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:10.656159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1385-2977-464f-a505-552673c6a43f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:10.657581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1385-2977-464f-a505-552673c6a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:10.674049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d540fd3-d76f-4eee-8ebf-b0c03406ea30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:10.675772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d540fd3-d76f-4eee-8ebf-b0c03406ea30 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:10.714045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 884/1765] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:19:10.719577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7ebc1385-2977-464f-a505-552673c6a43f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:10.725531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7ebc1385-2977-464f-a505-552673c6a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:10.951887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 882/1766] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:10.961608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f2b3-16e2-4d7d-a4c8-84400fe5adaa None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:10.962621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f2b3-16e2-4d7d-a4c8-84400fe5adaa None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:10.963557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f2b3-16e2-4d7d-a4c8-84400fe5adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:11.002369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1e95f2b3-16e2-4d7d-a4c8-84400fe5adaa None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:11.003848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1e95f2b3-16e2-4d7d-a4c8-84400fe5adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:11.051522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 885/1767] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:11.065499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc1385-2977-464f-a505-552673c6a43f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:11.094545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc1385-2977-464f-a505-552673c6a43f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:11.129131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:11.129840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:11.130121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:11.130392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:11.131129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:11.131434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:11.133663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:11.158777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 883/1768] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:19:11.160844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95f2b3-16e2-4d7d-a4c8-84400fe5adaa None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:11.170460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95f2b3-16e2-4d7d-a4c8-84400fe5adaa None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:11.185382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:11.186200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:11.186483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:11.186756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:11.187512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:11.189478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:11.259582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:11.260819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 886/1769] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:11 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:11.271323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3860934-2a71-493e-9f8b-505840860c35 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:11.305765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:11.307920 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:11.508689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:11.509392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:11.509706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:11.509984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:11.510773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:11.516642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c7c0f-4c17-4438-84b0-e9d6a6f5eb61 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:11.522117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:11.533583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:11.534490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:11.534776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:11.535053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] PATH_INFO: `/v3/users/ad2854afc58c44358332092a345c8b08` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:11.538106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2854afc58c44358332092a345c8b08)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:11.546097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:11.558300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 884/1770] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:11 2022] POST /identity/v3/users => generated 292 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:11.559250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:11.566368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:11.594551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db1c89-212d-4b33-ad5c-2828366ad407 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:11.606856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:11.607977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:11.608247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:11.608247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] PATH_INFO: `/v3/projects/042b2174874f4c079943e39937a465fa` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:11.616116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042b2174874f4c079943e39937a465fa)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:11.625625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:11.661834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:11.684895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2854afc58c44358332092a345c8b08'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.685602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2854afc58c44358332092a345c8b08'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.708135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2854afc58c44358332092a345c8b08'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.732520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2854afc58c44358332092a345c8b08'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.732520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2854afc58c44358332092a345c8b08'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.764907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 887/1771] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:11 2022] DELETE /identity/v3/users/ad2854afc58c44358332092a345c8b08 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:11.765952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:11.768316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:11.800324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042b2174874f4c079943e39937a465fa', 'request_id': 'req-4770230d-d17d-4530-82f3-b3c5fa9c28f4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.822671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042b2174874f4c079943e39937a465fa', 'request_id': 'req-4770230d-d17d-4530-82f3-b3c5fa9c28f4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.832599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:11.858521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042b2174874f4c079943e39937a465fa', 'request_id': 'req-4770230d-d17d-4530-82f3-b3c5fa9c28f4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.912305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] The token cache is being invalidate because project 042b2174874f4c079943e39937a465fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:11.913697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.914506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:11.923496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 885/1772] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:11 2022] DELETE /identity/v3/projects/042b2174874f4c079943e39937a465fa => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:11.926116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:11.928563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:12.023936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ed15-9044-46f2-bf71-bc3f9034a045 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:12.119540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770230d-d17d-4530-82f3-b3c5fa9c28f4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:12.138592 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:12.141070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.142240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.142908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] PATH_INFO: `/v3/projects/0bf116027454478d8f7d529a6feab0d1` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.146489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf116027454478d8f7d529a6feab0d1)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:12.148714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:12.188775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df977e2-ebcf-4e61-8d20-6afc81dee85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:12.189885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df977e2-ebcf-4e61-8d20-6afc81dee85d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.190471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df977e2-ebcf-4e61-8d20-6afc81dee85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.193708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df977e2-ebcf-4e61-8d20-6afc81dee85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.195229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df977e2-ebcf-4e61-8d20-6afc81dee85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:12.202036 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df977e2-ebcf-4e61-8d20-6afc81dee85d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:12.225589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 888/1773] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:12.227778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b394a-44bb-4af0-8d03-25bd6ae88add None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.228143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b394a-44bb-4af0-8d03-25bd6ae88add None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.228479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b394a-44bb-4af0-8d03-25bd6ae88add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.245636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf116027454478d8f7d529a6feab0d1', 'request_id': 'req-74d8244d-c715-4b02-bde5-7d7809b21be8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.252523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6b1b394a-44bb-4af0-8d03-25bd6ae88add None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:12.253871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6b1b394a-44bb-4af0-8d03-25bd6ae88add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:12.274239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf116027454478d8f7d529a6feab0d1', 'request_id': 'req-74d8244d-c715-4b02-bde5-7d7809b21be8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.290255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf116027454478d8f7d529a6feab0d1', 'request_id': 'req-74d8244d-c715-4b02-bde5-7d7809b21be8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.315451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] The token cache is being invalidate because project 0bf116027454478d8f7d529a6feab0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:12.315774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.316672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.332614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 886/1774] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:11 2022] DELETE /identity/v3/projects/0bf116027454478d8f7d529a6feab0d1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:12.333979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:12.335503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:12.372603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:12.396000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 889/1775] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:12.397766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec56ca-3480-413e-8a1c-2e9710edd22d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.398249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec56ca-3480-413e-8a1c-2e9710edd22d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.399228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec56ca-3480-413e-8a1c-2e9710edd22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.449418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8244d-c715-4b02-bde5-7d7809b21be8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:12.451338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9fec56ca-3480-413e-8a1c-2e9710edd22d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:12.452624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9fec56ca-3480-413e-8a1c-2e9710edd22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:12.456225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:12.457183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.457499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.457776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] PATH_INFO: `/v3/projects/f10be87d3f9d44ef9a57d4843c62bd20` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.459951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10be87d3f9d44ef9a57d4843c62bd20)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:12.471287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:12.482825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 890/1776] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:12.484138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1f5bf-6b0e-41e0-b648-75d0b6aa4d24 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.486931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1f5bf-6b0e-41e0-b648-75d0b6aa4d24 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.487923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1f5bf-6b0e-41e0-b648-75d0b6aa4d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.509062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:12.536077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c8f1f5bf-6b0e-41e0-b648-75d0b6aa4d24 None None] MFA Rules not processed for user `98a5a31ddbe04b2490689adcbe76f9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:12.545368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c8f1f5bf-6b0e-41e0-b648-75d0b6aa4d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:12.623944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10be87d3f9d44ef9a57d4843c62bd20', 'request_id': 'req-6579a528-5c99-415a-9bec-a7df0499d788'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.637609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10be87d3f9d44ef9a57d4843c62bd20', 'request_id': 'req-6579a528-5c99-415a-9bec-a7df0499d788'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.659870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10be87d3f9d44ef9a57d4843c62bd20', 'request_id': 'req-6579a528-5c99-415a-9bec-a7df0499d788'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.676760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] The token cache is being invalidate because project f10be87d3f9d44ef9a57d4843c62bd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:12.677164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.678075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:12.681501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 887/1777] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:12 2022] DELETE /identity/v3/projects/f10be87d3f9d44ef9a57d4843c62bd20 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:12.682610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:12.684413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:12.761692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 891/1778] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jun 30 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:12.762919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabed2d-a940-4b88-b2dc-1bf4dce0cdc6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.763205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabed2d-a940-4b88-b2dc-1bf4dce0cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.763487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabed2d-a940-4b88-b2dc-1bf4dce0cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.830288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3eabed2d-a940-4b88-b2dc-1bf4dce0cdc6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:12.831585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3eabed2d-a940-4b88-b2dc-1bf4dce0cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:12.880431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a528-5c99-415a-9bec-a7df0499d788 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:12.890623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:12.891317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:12.891645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:12.891940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:12.892962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:12.894787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:12.921889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 888/1779] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:12.927329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:12.930125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.030783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 892/1780] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:13.031959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.032230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.032507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.078547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:13.082314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.098069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac863d9-30e4-4962-bac4-42c4924db61a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.103347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 893/1781] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:13.103745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.104360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:13.104626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.104931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.105399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.106720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.111827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.134531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811c97-952e-4f65-aa89-85f10437fe34 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.141199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.146185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.146387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.147473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.147937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.148648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] PATH_INFO: `/v3/users/7c3a28bf2ab547d590743826f6c78887` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.150584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3a28bf2ab547d590743826f6c78887)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.164020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.182173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 889/1782] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:13.183106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:13.193926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b585ce-052e-4523-ad8d-866cec31907d service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.199164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.199877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.200164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.200561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.213587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.216091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.228077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 890/1783] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:13.229174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:13.232044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.249804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ed05-9680-4224-9657-3d1f165203f6 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.265349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3a28bf2ab547d590743826f6c78887'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:13.265696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3a28bf2ab547d590743826f6c78887'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:13.266708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.268893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.269181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.272345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.277653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.283273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3a28bf2ab547d590743826f6c78887'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:13.298063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.300331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.307984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3a28bf2ab547d590743826f6c78887'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:13.309155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-592f6de1-2e0d-4a1b-9db2-c5b0f1ac2673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3a28bf2ab547d590743826f6c78887'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:13.311912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 891/1784] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:13.312932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:13.314485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.342939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50884d09-fb42-483d-adf2-08e5e85265fb service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.368367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 894/1785] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:13 2022] DELETE /identity/v3/users/7c3a28bf2ab547d590743826f6c78887 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:13.370301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.370594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.371526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.380083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:13.391809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:13.402539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:13.405308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.518831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.521222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.521535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.524040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] PATH_INFO: `/v3/projects/e4ab6fce0ddf454f90544f870256e571/users/5daeba13ad744401881b24dfa3824afb/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.547180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 895/1786] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:13.548464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:13.550788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.563906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ab6fce0ddf454f90544f870256e571, user_id=5daeba13ad744401881b24dfa3824afb, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.567975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f5b5-e9f1-4d89-b6f1-5f610cedc7f2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.568785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.577124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7563b-5666-4e84-af2b-180913ad900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.578544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7563b-5666-4e84-af2b-180913ad900e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.579050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7563b-5666-4e84-af2b-180913ad900e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.580976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7563b-5666-4e84-af2b-180913ad900e admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.581961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7563b-5666-4e84-af2b-180913ad900e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:13.582383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7563b-5666-4e84-af2b-180913ad900e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.584634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7563b-5666-4e84-af2b-180913ad900e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.602039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 892/1787] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:13 2022] PUT /identity/v3/projects/e4ab6fce0ddf454f90544f870256e571/users/5daeba13ad744401881b24dfa3824afb/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:13.611041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:13.611149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 896/1788] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:13.669893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c4b8a-436f-4256-a9ec-8e19a694859a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.671715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c4b8a-436f-4256-a9ec-8e19a694859a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.672877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c4b8a-436f-4256-a9ec-8e19a694859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.755524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486fe47-e1ca-45b7-a65d-f74714c00442 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.767602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.768255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.768691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.768970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.771945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:13.772409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.774286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.791831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c55c4b8a-436f-4256-a9ec-8e19a694859a None None] MFA Rules not processed for user `5daeba13ad744401881b24dfa3824afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:13.796295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c55c4b8a-436f-4256-a9ec-8e19a694859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:13.808658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 893/1789] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:13.808658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:13.832625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c528e-0d5c-4920-80c2-72b2f068acf0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:13.849298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13ce25-6d0c-4878-835a-1b4559b03f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:13.849735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ce25-6d0c-4878-835a-1b4559b03f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.850027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ce25-6d0c-4878-835a-1b4559b03f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.850309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ce25-6d0c-4878-835a-1b4559b03f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:13.851152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13ce25-6d0c-4878-835a-1b4559b03f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:13.855192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13ce25-6d0c-4878-835a-1b4559b03f73 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:13.950994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 894/1790] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:13 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:13.952696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027657c-2e71-415c-9747-14f6e9798b91 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:13.952841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027657c-2e71-415c-9747-14f6e9798b91 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:13.953131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027657c-2e71-415c-9747-14f6e9798b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.006249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d027657c-2e71-415c-9747-14f6e9798b91 None None] MFA Rules not processed for user `0281a2bde51542e6af4ad2a23befe12b`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:14.010405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d027657c-2e71-415c-9747-14f6e9798b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:14.112339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 897/1791] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:14.112903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c4b8a-436f-4256-a9ec-8e19a694859a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.139631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c4b8a-436f-4256-a9ec-8e19a694859a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.202723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 895/1792] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:14.202723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027657c-2e71-415c-9747-14f6e9798b91 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.289010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:14.320928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.323660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.323975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.324267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.324998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.326980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.388575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027657c-2e71-415c-9747-14f6e9798b91 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.399623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 898/1793] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:14 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:14.400903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.401359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.402163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.402523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.402794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.403500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.405427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.416859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:14.471877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 896/1794] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:14 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:14.472788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.503485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50065-8b66-4e74-b836-c3d2a4bae9c0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.529571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.530370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.530685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.530860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.531655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.533746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.545570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d50fc-5cb0-4c7c-b83e-8a511930d284 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.551869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.552997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.553358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.553923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.554784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.558256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.577946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 897/1795] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:14 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:14.577946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.599840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f5fb-df7e-442d-ba5e-d0cd885375b9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.610983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.611716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.612052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.612326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.613232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.614968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.635068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 899/1796] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:14 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:14.636204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.646806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 898/1797] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:14.646806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.669624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3d8f-411e-43cc-8994-fe516766e602 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.738053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0355cd-eff3-4fbd-8de1-6b05b96e3523 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.744900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.745637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.745925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.746206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.746947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.750826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.767006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 900/1798] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:14.768082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.782521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0a6fd-e913-434b-9819-cb33417a4d02 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.789101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.789314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.789942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.790070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.790222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.790311 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.790498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.790640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.791245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.791642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.793175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.793475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.810712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 901/1799] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:14.812111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.827505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2929-857b-4e41-b6aa-fb2b96309bf4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.833798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 899/1800] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:14 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:14.834703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.837282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.838434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.838941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.839552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.840464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.842190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.861522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 902/1801] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:14.861522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.861859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2532739-4385-41e3-8cc7-06df58ebacef admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.872988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.873962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.874241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.874519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] PATH_INFO: `/v3/projects/abdc586e54654a80a94a01b2473238e3/users/58569fb3c6764af6988b244a3ad33c07/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.875204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aba20-7048-47be-9d7c-737be88ece95 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.881650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.882007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.882295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.882575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.884237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.886084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.903536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 903/1802] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:14.909193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.910874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdc586e54654a80a94a01b2473238e3, user_id=58569fb3c6764af6988b244a3ad33c07, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.913580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.923765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a519-59d8-4e17-928b-58a285d1f7ad admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:14.932869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93f22-86c4-4dca-9bdc-0b793540507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:14.933932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93f22-86c4-4dca-9bdc-0b793540507e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.934459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93f22-86c4-4dca-9bdc-0b793540507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.934459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93f22-86c4-4dca-9bdc-0b793540507e admin admin] PATH_INFO: `/v3/projects/39dea777faf444c4b616937934ad4813/users/45df64bd921442c49d259f63dc20b5ad/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:14.949952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 900/1803] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:14 2022] PUT /identity/v3/projects/abdc586e54654a80a94a01b2473238e3/users/58569fb3c6764af6988b244a3ad33c07/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:14.949952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:14.963339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93f22-86c4-4dca-9bdc-0b793540507e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39dea777faf444c4b616937934ad4813, user_id=45df64bd921442c49d259f63dc20b5ad, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:14.967628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93f22-86c4-4dca-9bdc-0b793540507e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:14.997927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 904/1804] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:14 2022] PUT /identity/v3/projects/39dea777faf444c4b616937934ad4813/users/45df64bd921442c49d259f63dc20b5ad/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:14.997927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687b0e-52d5-4c83-a81c-65241611cc5d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:14.997927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687b0e-52d5-4c83-a81c-65241611cc5d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:14.997927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687b0e-52d5-4c83-a81c-65241611cc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.042600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fc687b0e-52d5-4c83-a81c-65241611cc5d None None] MFA Rules not processed for user `58569fb3c6764af6988b244a3ad33c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:15.045839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fc687b0e-52d5-4c83-a81c-65241611cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:15.049813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:15.077282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:15.084543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95426bac-0dc6-4e26-a200-96be47e974bc admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:15.183558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 905/1805] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:15.183558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190fcc-ed5c-4bfb-8890-019f30acc9ae None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.184219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190fcc-ed5c-4bfb-8890-019f30acc9ae None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.184219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190fcc-ed5c-4bfb-8890-019f30acc9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.256493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ab190fcc-ed5c-4bfb-8890-019f30acc9ae None None] MFA Rules not processed for user `45df64bd921442c49d259f63dc20b5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:15.261790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ab190fcc-ed5c-4bfb-8890-019f30acc9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:15.325051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:15.326079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.326520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.326913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] PATH_INFO: `/v3/projects/9e5dc93dffbc4f13b0257d7947347597/users/a68909e1ffa04fc2a262c9436e276b17/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.373808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5dc93dffbc4f13b0257d7947347597, user_id=a68909e1ffa04fc2a262c9436e276b17, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:15.383778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:15.408225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 906/1806] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:15.409142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190fcc-ed5c-4bfb-8890-019f30acc9ae None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:15.428162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 901/1807] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:14 2022] PUT /identity/v3/projects/9e5dc93dffbc4f13b0257d7947347597/users/a68909e1ffa04fc2a262c9436e276b17/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:15.433712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:15.439465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190fcc-ed5c-4bfb-8890-019f30acc9ae None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:15.547837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a6888-5c80-47c4-a62e-0ed52f3b0898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:15.548797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6888-5c80-47c4-a62e-0ed52f3b0898 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.549094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6888-5c80-47c4-a62e-0ed52f3b0898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.549678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6888-5c80-47c4-a62e-0ed52f3b0898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.550393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a6888-5c80-47c4-a62e-0ed52f3b0898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:15.552782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a6888-5c80-47c4-a62e-0ed52f3b0898 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:15.598410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 907/1808] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:15 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:15.600223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7025-78fd-4e4b-9e65-5992fe698e7f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.600997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7025-78fd-4e4b-9e65-5992fe698e7f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.601384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7025-78fd-4e4b-9e65-5992fe698e7f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.603550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 908/1809] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:19:15.604601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7025-78fd-4e4b-9e65-5992fe698e7f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:15.631730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4ec3-2233-46b4-8230-34af80fcdcd0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:15.683898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:15.724512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7025-78fd-4e4b-9e65-5992fe698e7f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:15.733630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045f1aa-1117-4aa5-a171-7c4e26ca5938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:15.734474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045f1aa-1117-4aa5-a171-7c4e26ca5938 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.734762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045f1aa-1117-4aa5-a171-7c4e26ca5938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.735742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045f1aa-1117-4aa5-a171-7c4e26ca5938 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.737115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045f1aa-1117-4aa5-a171-7c4e26ca5938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:15.744179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045f1aa-1117-4aa5-a171-7c4e26ca5938 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:15.784305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 909/1810] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:15 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:15.786320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408d92-229a-42cb-bd68-a3b0f055809a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.786685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408d92-229a-42cb-bd68-a3b0f055809a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.786966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408d92-229a-42cb-bd68-a3b0f055809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.795029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:15.795720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.796004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.796278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.797852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:15.799494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:15.821806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-dd408d92-229a-42cb-bd68-a3b0f055809a None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:15.824052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dd408d92-229a-42cb-bd68-a3b0f055809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:15.831385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 902/1811] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:15.832275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:15.850692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:15.894991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b99f-f33a-4a7b-9738-45948c7084ae admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:15.916338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:15.917629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.918155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.918653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] PATH_INFO: `/v3/projects/3972085479d543ef8c68c13649b1aad2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.923657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3972085479d543ef8c68c13649b1aad2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:15.925940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:15.938080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 910/1812] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:15.939197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408d92-229a-42cb-bd68-a3b0f055809a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:15.956154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:15.956893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408d92-229a-42cb-bd68-a3b0f055809a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:15.965151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:15.966279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:15.966739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:15.967507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:15.970722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:15.973827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:15.994674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 911/1813] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:15.995954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:16.010245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb333660-2b4a-498c-9845-04349f2c7cd2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:16.025851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3972085479d543ef8c68c13649b1aad2', 'request_id': 'req-45c66704-352c-45d2-889d-63fe75e10bfa'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.048553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3972085479d543ef8c68c13649b1aad2', 'request_id': 'req-45c66704-352c-45d2-889d-63fe75e10bfa'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.058854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3972085479d543ef8c68c13649b1aad2', 'request_id': 'req-45c66704-352c-45d2-889d-63fe75e10bfa'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.077274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] The token cache is being invalidate because project 3972085479d543ef8c68c13649b1aad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:16.077743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.079152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.084947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 903/1814] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:15 2022] DELETE /identity/v3/projects/3972085479d543ef8c68c13649b1aad2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:16.089144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:16.098440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:16.121062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:16.122049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:16.122468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:16.122681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] PATH_INFO: `/v3/projects/9e5dc93dffbc4f13b0257d7947347597/users/a68909e1ffa04fc2a262c9436e276b17/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:16.126028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5dc93dffbc4f13b0257d7947347597, user_id=a68909e1ffa04fc2a262c9436e276b17, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:16.132022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:16.147826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 912/1815] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:15 2022] PUT /identity/v3/projects/9e5dc93dffbc4f13b0257d7947347597/users/a68909e1ffa04fc2a262c9436e276b17/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:16.159355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:16.161570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:16.252257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:16.280180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ac09-1fc3-487b-9ba7-ee5a7b0e6a87 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:16.282314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c66704-352c-45d2-889d-63fe75e10bfa admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:16.285991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:16.286991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:16.287280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:16.287556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] PATH_INFO: `/v3/users/898ec4a6253a4cf486075c138f76b3d9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:16.289103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898ec4a6253a4cf486075c138f76b3d9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:16.291699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:16.298552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ad91c-3673-420b-a0f8-6bb84a2258bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:16.300650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad91c-3673-420b-a0f8-6bb84a2258bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:16.301183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad91c-3673-420b-a0f8-6bb84a2258bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:16.301714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad91c-3673-420b-a0f8-6bb84a2258bb admin admin] PATH_INFO: `/v3/projects/5fb3051341944b4c830a4cfe97ad70b6/users/f46b1e59adf748f5adb002f387e3af36/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:16.332230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ad91c-3673-420b-a0f8-6bb84a2258bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb3051341944b4c830a4cfe97ad70b6, user_id=f46b1e59adf748f5adb002f387e3af36, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:16.335591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ad91c-3673-420b-a0f8-6bb84a2258bb admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:16.373253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 904/1816] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:16 2022] PUT /identity/v3/projects/5fb3051341944b4c830a4cfe97ad70b6/users/f46b1e59adf748f5adb002f387e3af36/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:16.374857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:16.375283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:16.375672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:16.376584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898ec4a6253a4cf486075c138f76b3d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.379141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898ec4a6253a4cf486075c138f76b3d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.406850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898ec4a6253a4cf486075c138f76b3d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.426380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] MFA Rules not processed for user `a68909e1ffa04fc2a262c9436e276b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:16.428808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:16.455932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898ec4a6253a4cf486075c138f76b3d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.457140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898ec4a6253a4cf486075c138f76b3d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.477342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 913/1817] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:16 2022] DELETE /identity/v3/users/898ec4a6253a4cf486075c138f76b3d9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:16.478543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:16.480797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:16.603655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 905/1818] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:16.604711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:16.606689 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:16.625343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e0c16-9552-4e25-9e58-ddfbbc6e99c2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:16.637719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:16.645246 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:16.646391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:16.648208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:16.649136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] PATH_INFO: `/v3/projects/ed93b90e93094bedb26d487cef8f5a03` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:16.651200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed93b90e93094bedb26d487cef8f5a03)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:16.662761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:16.772391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed93b90e93094bedb26d487cef8f5a03', 'request_id': 'req-3e2b09fe-16d7-4f94-ba7c-7da430849e10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.784505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd4109-87f9-4dee-bc35-af35f903dbf6 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:16.789912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed93b90e93094bedb26d487cef8f5a03', 'request_id': 'req-3e2b09fe-16d7-4f94-ba7c-7da430849e10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.807573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed93b90e93094bedb26d487cef8f5a03', 'request_id': 'req-3e2b09fe-16d7-4f94-ba7c-7da430849e10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.813997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:16.850543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] The token cache is being invalidate because project ed93b90e93094bedb26d487cef8f5a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:16.851136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.852891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:16.860013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 914/1819] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:16 2022] DELETE /identity/v3/projects/ed93b90e93094bedb26d487cef8f5a03 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:16.861809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:16.866847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:16.959893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:16.961026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:16.963061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:16.963472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:16.964472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:16.969143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:16.998551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 906/1820] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:16.999520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:17.004469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.020161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b09fe-16d7-4f94-ba7c-7da430849e10 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:17.029367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:17.030330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:17.031364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:17.032459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:17.035244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af09808-1c18-4358-bdea-8a5a78bb04dd admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:17.036844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.049631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:17.050766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:17.051199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:17.051620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] PATH_INFO: `/v3/users/7706af9135434aa4bcc3ab895e14f178` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:17.054389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7706af9135434aa4bcc3ab895e14f178)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:17.058728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:17.155076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7706af9135434aa4bcc3ab895e14f178'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:17.156920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7706af9135434aa4bcc3ab895e14f178'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:17.199365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7706af9135434aa4bcc3ab895e14f178'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:17.199365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7706af9135434aa4bcc3ab895e14f178'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:17.203535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7706af9135434aa4bcc3ab895e14f178'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:17.210314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:17.216919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:17.223628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 907/1821] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:16 2022] DELETE /identity/v3/users/7706af9135434aa4bcc3ab895e14f178 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:17.224852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:17.226267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.246240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 915/1822] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:17.247365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:17.252515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.271192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:17.324013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57a09-c614-4957-a8f1-d06dbe2c8fce admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:17.331355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dd3f9-3c0f-4ca9-83cb-c021955ebd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:17.332555 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd3f9-3c0f-4ca9-83cb-c021955ebd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:17.333723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd3f9-3c0f-4ca9-83cb-c021955ebd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:17.333723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd3f9-3c0f-4ca9-83cb-c021955ebd0f admin admin] PATH_INFO: `/v3/projects/5fb3051341944b4c830a4cfe97ad70b6/users/f46b1e59adf748f5adb002f387e3af36/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:17.345552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dd3f9-3c0f-4ca9-83cb-c021955ebd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb3051341944b4c830a4cfe97ad70b6, user_id=f46b1e59adf748f5adb002f387e3af36, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:17.357716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dd3f9-3c0f-4ca9-83cb-c021955ebd0f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:17.373675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 908/1823] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:17 2022] PUT /identity/v3/projects/5fb3051341944b4c830a4cfe97ad70b6/users/f46b1e59adf748f5adb002f387e3af36/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:17.385955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:17.386594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:17.387046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:17.462612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f2d3-24f0-4617-967c-18bc22bb0805 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:17.464307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] MFA Rules not processed for user `f46b1e59adf748f5adb002f387e3af36`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:17.465603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.514073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:17.548254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:17.548951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:17.548951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:17.549541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:17.553717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.690673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 909/1824] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:17.692420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:17.702309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.716104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:17.718743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:17.741824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 916/1825] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:17.742739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:17.744778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.866528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208228db-a151-4332-9c88-84a6faf3d5c2 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:17.873626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:17.875620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:17.875905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:17.876186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:17.879819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:17.915451 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6147daf-c7a5-4124-af4f-b98300b76819 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:17.928521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:17.929808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:17.930097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:17.932048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] PATH_INFO: `/v3/projects/60c947d7fff44fd4824aac786e1a695b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:17.934916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c947d7fff44fd4824aac786e1a695b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:17.940938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:18.051276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c947d7fff44fd4824aac786e1a695b', 'request_id': 'req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.057536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:18.059016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:18.074238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c947d7fff44fd4824aac786e1a695b', 'request_id': 'req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.079949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:18.102571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c947d7fff44fd4824aac786e1a695b', 'request_id': 'req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.106195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 910/1826] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:18.107112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:18.116643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.153063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] The token cache is being invalidate because project 60c947d7fff44fd4824aac786e1a695b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:18.153364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.154107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.155731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 917/1827] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:17 2022] DELETE /identity/v3/projects/60c947d7fff44fd4824aac786e1a695b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:18.179675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:18.183604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adc2fb-e201-460c-982e-e9073e4784d1 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:18.186655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.225918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:18.306524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f8d95-558d-4788-bfe0-ae2df47f1925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:18.307626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f8d95-558d-4788-bfe0-ae2df47f1925 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.308064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f8d95-558d-4788-bfe0-ae2df47f1925 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.308480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f8d95-558d-4788-bfe0-ae2df47f1925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.311060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e87f8d95-558d-4788-bfe0-ae2df47f1925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.331422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ba5a-6333-4f9e-9c10-94b95efeddf0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:18.358880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04ec73-4e18-428b-a65b-6d5c67128648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:18.359572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04ec73-4e18-428b-a65b-6d5c67128648 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.359922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04ec73-4e18-428b-a65b-6d5c67128648 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.360204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04ec73-4e18-428b-a65b-6d5c67128648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.362305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ce04ec73-4e18-428b-a65b-6d5c67128648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.380911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04ec73-4e18-428b-a65b-6d5c67128648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:18.382638 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04ec73-4e18-428b-a65b-6d5c67128648 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:18.400830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 918/1828] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:18.403483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f004d5-6737-4c3c-a464-af4c19e83d7b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.404120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f004d5-6737-4c3c-a464-af4c19e83d7b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.404507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f004d5-6737-4c3c-a464-af4c19e83d7b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.406286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 919/1829] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:19:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:19:18.407540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f004d5-6737-4c3c-a464-af4c19e83d7b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:18.410147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a9f004d5-6737-4c3c-a464-af4c19e83d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.431941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f8d95-558d-4788-bfe0-ae2df47f1925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:18.433392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f8d95-558d-4788-bfe0-ae2df47f1925 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:18.472472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 911/1830] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:18.475576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0127-9db5-463b-b916-986a4364988a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.475869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0127-9db5-463b-b916-986a4364988a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.476292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0127-9db5-463b-b916-986a4364988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.522911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-eebf0127-9db5-463b-b916-986a4364988a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:18.524187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-eebf0127-9db5-463b-b916-986a4364988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.561507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 912/1831] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:18.561507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a655a-959e-4daa-ad23-7d360b6a6d14 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.561507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a655a-959e-4daa-ad23-7d360b6a6d14 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.561507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a655a-959e-4daa-ad23-7d360b6a6d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.600266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f004d5-6737-4c3c-a464-af4c19e83d7b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:18.604710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-473a655a-959e-4daa-ad23-7d360b6a6d14 None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:18.606043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-473a655a-959e-4daa-ad23-7d360b6a6d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.606873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:18.609257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.609948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.610568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] PATH_INFO: `/v3/projects/44aa0db193e646d2be0b6aba6560d2e4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.612160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44aa0db193e646d2be0b6aba6560d2e4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:18.630824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:18.641751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 913/1832] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:18.643083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.643396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.643636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.696484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:18.697811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.716566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 914/1833] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:18.717430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:18.726695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.738821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44aa0db193e646d2be0b6aba6560d2e4', 'request_id': 'req-28aaad59-66b2-42c1-aec4-8724ba487147'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.745324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6fca0-f7ba-44c8-9234-5257da475064 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:18.761683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44aa0db193e646d2be0b6aba6560d2e4', 'request_id': 'req-28aaad59-66b2-42c1-aec4-8724ba487147'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.786105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44aa0db193e646d2be0b6aba6560d2e4', 'request_id': 'req-28aaad59-66b2-42c1-aec4-8724ba487147'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.831713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] The token cache is being invalidate because project 44aa0db193e646d2be0b6aba6560d2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:18.832043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.833251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:18.840470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 920/1834] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:18 2022] DELETE /identity/v3/projects/44aa0db193e646d2be0b6aba6560d2e4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:18.841409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:18.843269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:18.879457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:18.931345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaad59-66b2-42c1-aec4-8724ba487147 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:18.936538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:18.937441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.937747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.938020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] PATH_INFO: `/v3/users/5daeba13ad744401881b24dfa3824afb` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.941622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b27e99-2122-4ba9-8c5b-af16845a1f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:18.942125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27e99-2122-4ba9-8c5b-af16845a1f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.942862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27e99-2122-4ba9-8c5b-af16845a1f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.942862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27e99-2122-4ba9-8c5b-af16845a1f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:18.943767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b27e99-2122-4ba9-8c5b-af16845a1f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:18.944082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b27e99-2122-4ba9-8c5b-af16845a1f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:18.944287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daeba13ad744401881b24dfa3824afb)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:18.946850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b27e99-2122-4ba9-8c5b-af16845a1f7b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:18.949114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:18.996175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 921/1835] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:18.997664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f5c7e-35f9-4691-a951-0f848b1097c5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:18.997931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f5c7e-35f9-4691-a951-0f848b1097c5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:18.998207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f5c7e-35f9-4691-a951-0f848b1097c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.038134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-086f5c7e-35f9-4691-a951-0f848b1097c5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:19.039448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-086f5c7e-35f9-4691-a951-0f848b1097c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.056731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:19.062547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 922/1836] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:19.068885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f5c7e-35f9-4691-a951-0f848b1097c5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.089488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f5c7e-35f9-4691-a951-0f848b1097c5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.089987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daeba13ad744401881b24dfa3824afb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:19.091549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daeba13ad744401881b24dfa3824afb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:19.114593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea55bd-8c39-43b9-8500-419c045b370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.115299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea55bd-8c39-43b9-8500-419c045b370c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.115608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea55bd-8c39-43b9-8500-419c045b370c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.115892 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea55bd-8c39-43b9-8500-419c045b370c admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.116677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea55bd-8c39-43b9-8500-419c045b370c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.119255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea55bd-8c39-43b9-8500-419c045b370c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.126952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daeba13ad744401881b24dfa3824afb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:19.127818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daeba13ad744401881b24dfa3824afb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:19.146525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-48372800-bbda-4504-a8b4-5e0c4d549640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daeba13ad744401881b24dfa3824afb'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:19.177377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 915/1837] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:18 2022] DELETE /identity/v3/users/5daeba13ad744401881b24dfa3824afb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:19.184333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.189889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 923/1838] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:19 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:19.190966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.190966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.191147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.191147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.191147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.222830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:19.224846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.250247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:19.252087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.363228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 916/1839] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:19.364235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.367561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.388506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db476-7edf-492b-b6dd-61703db8996c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.393166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 924/1840] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:19.394458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.395949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.401766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.402964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.403258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.403537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.404256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.407186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.437999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 917/1841] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:19 2022] POST /identity/v3/users => generated 295 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:19.438903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.441946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.488628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03e17-946f-44c3-9007-182e6f47e5c0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.496419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.497233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.497581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.498077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.500089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.516991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.519039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.529881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517a08-6714-46c6-9738-3a7d58f3b52f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.533523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 925/1842] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:19.534827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.547335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e0722-e5ac-40b0-a2a4-b18853838cd5 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.550931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b1e59adf748f5adb002f387e3af36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fb3051341944b4c830a4cfe97ad70b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.552982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.553276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.553414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.555446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.556132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.556585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.557028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.557628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:19.557954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.558495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:19.559032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.559876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.561881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.574868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:19.581975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 926/1843] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:19.583542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.589442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:19.593240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 918/1844] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:19.594397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.619274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c95ec7-85f4-480f-a828-7812c03ea042 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.626108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.626820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.627230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.627628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.629280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.630662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.650152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 919/1845] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:19.651034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.662789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761fc7-d1fb-4aa5-8d39-a4cecb8aebb4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.666900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72855ca-a728-413a-9d29-358014742f6d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.670141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.670944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.671229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.671505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.672268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.673148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.674288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.674769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.675268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.676116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.686381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:19.690585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.692782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.706180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 927/1846] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:19.707305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.707542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 920/1847] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:19 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:19.709413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.735104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb97c0c-f3e8-425a-b257-d9a82f6307e7 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.866351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131fcb-77dc-43ba-b8bb-98b40ddfdffb admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.873262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.874210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.875316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.875316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.876211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.878060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.880820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b1e59adf748f5adb002f387e3af36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fb3051341944b4c830a4cfe97ad70b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.881513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.881802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.882095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.882933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.885617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.899583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 921/1848] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:19.899583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.933628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041abc-5e9b-4701-97e9-6af163df7f64 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:19.941953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:19.943361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:19.943915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:19.944393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:19.945396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:19.947958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:19.951929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 928/1849] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:19 2022] POST /identity/v3/projects => generated 354 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:19.951929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:19.987589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 922/1850] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:19 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:19.987589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.015304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5420c2-dc4f-43da-bf40-ac20173e41ab admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.068308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ff7c-7c35-4a64-bc0e-4d36dd614090 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.075723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.076694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.077085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.077649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] PATH_INFO: `/v3/projects/95932f3c092e4c34b92a549ff6233537/users/0ced1c870ba54a8b80900ffd3b0fd33e/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.100140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95932f3c092e4c34b92a549ff6233537, user_id=0ced1c870ba54a8b80900ffd3b0fd33e, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.103548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.114501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b1e59adf748f5adb002f387e3af36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fb3051341944b4c830a4cfe97ad70b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.115429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.115898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.116178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.116917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:20.117227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.118979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.120903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 929/1851] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:19 2022] PUT /identity/v3/projects/95932f3c092e4c34b92a549ff6233537/users/0ced1c870ba54a8b80900ffd3b0fd33e/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:20.122116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.136710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:20.147286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 923/1852] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:20.147286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.147883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.166762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa972d-5714-4804-8a08-8d8a0648a06d tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.223958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48e66f-fa5a-49d7-8402-5a98cc4002a6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.229421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bf0a9-dd49-4772-a487-2839c1f11e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.230141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bf0a9-dd49-4772-a487-2839c1f11e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.230460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bf0a9-dd49-4772-a487-2839c1f11e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.230739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bf0a9-dd49-4772-a487-2839c1f11e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.231619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bf0a9-dd49-4772-a487-2839c1f11e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.233260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bf0a9-dd49-4772-a487-2839c1f11e54 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.233640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.241171 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.241523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.241764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] PATH_INFO: `/v3/users/45df64bd921442c49d259f63dc20b5ad` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.243714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45df64bd921442c49d259f63dc20b5ad)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.246258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.247035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 930/1853] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:20.247035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.247035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.247035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.254993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:20.283090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] MFA Rules not processed for user `0ced1c870ba54a8b80900ffd3b0fd33e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:20.284699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.312799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45df64bd921442c49d259f63dc20b5ad'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.313523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45df64bd921442c49d259f63dc20b5ad'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.328822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45df64bd921442c49d259f63dc20b5ad'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.330220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45df64bd921442c49d259f63dc20b5ad'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.339835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45df64bd921442c49d259f63dc20b5ad'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.358615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 924/1854] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:20 2022] DELETE /identity/v3/users/45df64bd921442c49d259f63dc20b5ad => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:20.362144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.363758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.367356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 931/1855] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:20.368076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.369338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.437779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9c162-6420-4628-b536-1598570b7e14 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.442446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.443002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd796d-4115-4c5f-8828-2a4b18ed7f82 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.443445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.443670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.443844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] PATH_INFO: `/v3/projects/e4ab6fce0ddf454f90544f870256e571` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.445565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ab6fce0ddf454f90544f870256e571)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.447444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.487438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:20.494705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ab6fce0ddf454f90544f870256e571', 'request_id': 'req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.500690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ab6fce0ddf454f90544f870256e571', 'request_id': 'req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.504154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b1e59adf748f5adb002f387e3af36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fb3051341944b4c830a4cfe97ad70b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.505125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.505618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.505927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] PATH_INFO: `/v3/projects/f200f670b78c455c9f8fa572a7e3aecd` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.509444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f200f670b78c455c9f8fa572a7e3aecd)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.510996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ab6fce0ddf454f90544f870256e571', 'request_id': 'req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.511520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.526031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] The token cache is being invalidate because project e4ab6fce0ddf454f90544f870256e571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:20.526362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.527097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.528902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 925/1856] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:20 2022] DELETE /identity/v3/projects/e4ab6fce0ddf454f90544f870256e571 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:20.529779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.531066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.547856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:20.569816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f200f670b78c455c9f8fa572a7e3aecd', 'request_id': 'req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.578931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f200f670b78c455c9f8fa572a7e3aecd', 'request_id': 'req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.586663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f200f670b78c455c9f8fa572a7e3aecd', 'request_id': 'req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.597155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] The token cache is being invalidate because project f200f670b78c455c9f8fa572a7e3aecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:20.597440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.598104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bb33fb12-1b45-41da-8076-a8e8f9d4ced5 tempest-VolumeQuotaClassesTest-1929920234 tempest-VolumeQuotaClassesTest-1929920234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.599704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 932/1857] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:20 2022] DELETE /identity/v3/projects/f200f670b78c455c9f8fa572a7e3aecd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:20.600917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.601224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.601529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.603114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47cf72-2c8d-4ee9-84c6-5c8e642f23a7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.619870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:20.621004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.677305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.678286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.678768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.679064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.680591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.682562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.689530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 933/1858] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:20.696866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.698468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.704991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 926/1859] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:20.704991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.704991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.718132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ccc5-1af6-4100-b677-cbd95bb149a2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.719212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8f76-f856-47ef-8bed-0fe250ec2fa7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.723271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.724034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.724327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.724614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.725119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.725316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.726051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.726726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.727023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] PATH_INFO: `/v3/users/a68909e1ffa04fc2a262c9436e276b17` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.727460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.728239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68909e1ffa04fc2a262c9436e276b17)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.730190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:20.768346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 934/1860] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:20 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:20.769820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.771660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.789430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68909e1ffa04fc2a262c9436e276b17'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.790350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68909e1ffa04fc2a262c9436e276b17'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.837947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68909e1ffa04fc2a262c9436e276b17'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.838932 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68909e1ffa04fc2a262c9436e276b17'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.850902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21e233-0c07-4b36-9c00-4bc39dd1bd9c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:20.853237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68909e1ffa04fc2a262c9436e276b17'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:20.855767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:20.856622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:20.857012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:20.857600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:20.860587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.869697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:20.897781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 927/1861] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:20 2022] DELETE /identity/v3/users/a68909e1ffa04fc2a262c9436e276b17 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:20.899699 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:20.905148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:20.970910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:20.986635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:20.988287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.004707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 935/1862] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:21.005996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.008683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.022928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124282d4-8506-4c36-8554-0aa3ffe288e7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.023713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f021a-9fdb-4144-bc89-9d49b91e2817 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.031348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.031761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.032055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.032339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.033044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.035281 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.041928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.042876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.043505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.045430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] PATH_INFO: `/v3/projects/d18ac985a29e45049ca72b494de13b83/users/36a41b3046ac449db696a302bba08df1/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.074493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 936/1863] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:21 2022] POST /identity/v3/users => generated 301 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:21.075478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.077326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.093433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559af57e-9efa-4abb-84bf-03f4ab4fbcb3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.096292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18ac985a29e45049ca72b494de13b83, user_id=36a41b3046ac449db696a302bba08df1, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.098561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.099504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.099790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.100066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] PATH_INFO: `/v3/users/58569fb3c6764af6988b244a3ad33c07` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.102977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58569fb3c6764af6988b244a3ad33c07)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.103111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.104907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.136794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 928/1864] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:20 2022] PUT /identity/v3/projects/d18ac985a29e45049ca72b494de13b83/users/36a41b3046ac449db696a302bba08df1/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:21.137710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.194800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58569fb3c6764af6988b244a3ad33c07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.196779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58569fb3c6764af6988b244a3ad33c07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.212607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58569fb3c6764af6988b244a3ad33c07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.236568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58569fb3c6764af6988b244a3ad33c07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.237312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c357b55d-48db-4e1e-aa74-3df4262be748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58569fb3c6764af6988b244a3ad33c07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.241032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561f283-9ea1-4a14-a50e-a5e5ed5d333d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.249751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff63a-1e86-4770-82c1-dd9947ecd60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.250538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff63a-1e86-4770-82c1-dd9947ecd60b admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.250824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff63a-1e86-4770-82c1-dd9947ecd60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.251381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff63a-1e86-4770-82c1-dd9947ecd60b admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.252130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dff63a-1e86-4770-82c1-dd9947ecd60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.254679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dff63a-1e86-4770-82c1-dd9947ecd60b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.264033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 937/1865] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:21 2022] DELETE /identity/v3/users/58569fb3c6764af6988b244a3ad33c07 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:21.265659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.265949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.266368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.278031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 929/1866] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:21.279576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.279869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.280145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.307585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:21.307585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.319789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] MFA Rules not processed for user `36a41b3046ac449db696a302bba08df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:21.321697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.385526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 930/1867] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:21.386505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.389662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:21.390426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.406944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0af5e8-9c4a-4d5b-984e-432dbbf13b79 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.412270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.413155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.413432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.413806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] PATH_INFO: `/v3/projects/05833e5d3d7948ac86bb311451cae8a3/users/4ac66a46225e40578bef03ef3ed9795e/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.418610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 938/1868] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:21.419235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.420493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.434989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05833e5d3d7948ac86bb311451cae8a3, user_id=4ac66a46225e40578bef03ef3ed9795e, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.437702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.458166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 931/1869] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:21 2022] PUT /identity/v3/projects/05833e5d3d7948ac86bb311451cae8a3/users/4ac66a46225e40578bef03ef3ed9795e/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:21.462535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.462535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.503127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:21.550440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1914d-0b54-42a1-a1a3-f85fdd5629e1 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.558370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.559417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.559907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.560370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.561260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.563612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.626181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 932/1870] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:21 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:21.627306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.743715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e5465-e83b-442b-9708-de21ac78d806 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.774330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e296bf-7b59-4142-ac4a-954736f4958a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.779523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.780225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.780507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.780779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.781530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.783135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.793438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 933/1871] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:21.795350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.805235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41911d66-b504-4b0a-9e2a-6a4c641a1e22 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.808059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.808761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.809046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.809322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.812396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.813050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.813329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.813634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.814326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.816220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.818840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.820796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.831343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 939/1872] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:21.832181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.833728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.841012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 934/1873] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:21 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:21.841012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.843921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.848507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36b5e-efc8-4ac8-8a2c-d0b1edcbc55e service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.854082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.854928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.855206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.855475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] PATH_INFO: `/v3/projects/39dea777faf444c4b616937934ad4813` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.856698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39dea777faf444c4b616937934ad4813)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.857146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65da1-fae4-4d34-abb5-71aa3cb6de0c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:21.858615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.863460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:21.863713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:21.864136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:21.864582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] PATH_INFO: `/v3/projects/9e5dc93dffbc4f13b0257d7947347597` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:21.865822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5dc93dffbc4f13b0257d7947347597)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:21.867750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:21.913586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39dea777faf444c4b616937934ad4813', 'request_id': 'req-d82d0625-8ed9-4ca7-a75b-8271a6298755'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.921589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5dc93dffbc4f13b0257d7947347597', 'request_id': 'req-7f3d1f84-7f60-4103-b3b0-6714beda2f25'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.923143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39dea777faf444c4b616937934ad4813', 'request_id': 'req-d82d0625-8ed9-4ca7-a75b-8271a6298755'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.928908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5dc93dffbc4f13b0257d7947347597', 'request_id': 'req-7f3d1f84-7f60-4103-b3b0-6714beda2f25'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.930651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39dea777faf444c4b616937934ad4813', 'request_id': 'req-d82d0625-8ed9-4ca7-a75b-8271a6298755'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.937913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5dc93dffbc4f13b0257d7947347597', 'request_id': 'req-7f3d1f84-7f60-4103-b3b0-6714beda2f25'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.942819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] The token cache is being invalidate because project 39dea777faf444c4b616937934ad4813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:21.943218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.944265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.946605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 940/1874] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:21 2022] DELETE /identity/v3/projects/39dea777faf444c4b616937934ad4813 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:21.947408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.948970 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.954717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] The token cache is being invalidate because project 9e5dc93dffbc4f13b0257d7947347597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:21.955204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.956476 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:21.958800 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 935/1875] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:21 2022] DELETE /identity/v3/projects/9e5dc93dffbc4f13b0257d7947347597 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:21.959786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:21.962268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:21.977402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:21.991143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:22.029903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d0625-8ed9-4ca7-a75b-8271a6298755 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.034849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dfddf-7ee7-4a42-b8ee-120725242913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.035533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfddf-7ee7-4a42-b8ee-120725242913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.035810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfddf-7ee7-4a42-b8ee-120725242913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.036111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfddf-7ee7-4a42-b8ee-120725242913 admin admin] PATH_INFO: `/v3/projects/05833e5d3d7948ac86bb311451cae8a3/users/4ac66a46225e40578bef03ef3ed9795e/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.038339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dfddf-7ee7-4a42-b8ee-120725242913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05833e5d3d7948ac86bb311451cae8a3, user_id=4ac66a46225e40578bef03ef3ed9795e, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.040119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1f84-7f60-4103-b3b0-6714beda2f25 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.041002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dfddf-7ee7-4a42-b8ee-120725242913 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.045385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eb320-81bc-4dfa-8a58-16d5ceabd49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.046348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eb320-81bc-4dfa-8a58-16d5ceabd49d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.046536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eb320-81bc-4dfa-8a58-16d5ceabd49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.047267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eb320-81bc-4dfa-8a58-16d5ceabd49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.047666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770eb320-81bc-4dfa-8a58-16d5ceabd49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.049562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770eb320-81bc-4dfa-8a58-16d5ceabd49d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.063156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 941/1876] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:21 2022] PUT /identity/v3/projects/05833e5d3d7948ac86bb311451cae8a3/users/4ac66a46225e40578bef03ef3ed9795e/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:22.063156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709510a2-c614-4341-9f2d-ebb99da68c78 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.063156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709510a2-c614-4341-9f2d-ebb99da68c78 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.063156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709510a2-c614-4341-9f2d-ebb99da68c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.074374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 936/1877] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:22.075916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb754d-4c71-4076-b9dc-703e02c4ead7 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.075916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb754d-4c71-4076-b9dc-703e02c4ead7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.075916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb754d-4c71-4076-b9dc-703e02c4ead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.093981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-709510a2-c614-4341-9f2d-ebb99da68c78 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:22.095188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-709510a2-c614-4341-9f2d-ebb99da68c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.106376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7deb754d-4c71-4076-b9dc-703e02c4ead7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:22.107720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7deb754d-4c71-4076-b9dc-703e02c4ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.199945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 942/1878] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:22.201315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d107-a296-45ba-b97c-d729b7134b9c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.201632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d107-a296-45ba-b97c-d729b7134b9c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.201910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d107-a296-45ba-b97c-d729b7134b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.211041 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 937/1879] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:22.212119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb754d-4c71-4076-b9dc-703e02c4ead7 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.222128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb754d-4c71-4076-b9dc-703e02c4ead7 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.226921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.227818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.228104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.228385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] PATH_INFO: `/v3/projects/3a1cd3f76e4a48099ca470f7f4cd8955/users/327f20f788694ca4ada0b72dd9ffefdf/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.231175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0604d107-a296-45ba-b97c-d729b7134b9c None None] MFA Rules not processed for user `4ac66a46225e40578bef03ef3ed9795e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:22.232370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0604d107-a296-45ba-b97c-d729b7134b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.244813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cd3f76e4a48099ca470f7f4cd8955, user_id=327f20f788694ca4ada0b72dd9ffefdf, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.247634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.262464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 938/1880] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:22 2022] PUT /identity/v3/projects/3a1cd3f76e4a48099ca470f7f4cd8955/users/327f20f788694ca4ada0b72dd9ffefdf/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:22.263499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.265589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.300354 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 943/1881] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:22.301564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1fa0-2fe5-4041-8efe-899c6d2dd95e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.301861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1fa0-2fe5-4041-8efe-899c6d2dd95e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.302141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1fa0-2fe5-4041-8efe-899c6d2dd95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.322313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f3de1fa0-2fe5-4041-8efe-899c6d2dd95e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:22.323551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f3de1fa0-2fe5-4041-8efe-899c6d2dd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.331870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 944/1882] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:22.333374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335c7fa-9aa7-4ec7-babf-8ec87e130f30 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.333695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335c7fa-9aa7-4ec7-babf-8ec87e130f30 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.333979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335c7fa-9aa7-4ec7-babf-8ec87e130f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.340657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb86378-9d04-4f74-aa7d-b381beaf304a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.345714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.346738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.347065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.347366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] PATH_INFO: `/v3/projects/abdc586e54654a80a94a01b2473238e3` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.353092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdc586e54654a80a94a01b2473238e3)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.353092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.353423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8335c7fa-9aa7-4ec7-babf-8ec87e130f30 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:22.354680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8335c7fa-9aa7-4ec7-babf-8ec87e130f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.362902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 945/1883] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:22.363708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335c7fa-9aa7-4ec7-babf-8ec87e130f30 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.375794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335c7fa-9aa7-4ec7-babf-8ec87e130f30 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.383233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.384015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.384299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.384580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.385185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:22.385294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.387005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.399837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 946/1884] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:22.404313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.406064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.408371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdc586e54654a80a94a01b2473238e3', 'request_id': 'req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.416351 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdc586e54654a80a94a01b2473238e3', 'request_id': 'req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.425050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdc586e54654a80a94a01b2473238e3', 'request_id': 'req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.437505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:22.440422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] The token cache is being invalidate because project abdc586e54654a80a94a01b2473238e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:22.440721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.441447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.444157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 939/1885] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:22 2022] DELETE /identity/v3/projects/abdc586e54654a80a94a01b2473238e3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:22.449088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.451286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.476463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1015b-b6ad-4784-91fe-57d06425f80a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.524977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.525660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.525944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.526217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.528012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.528629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e9d5-c70a-482f-8d7f-91eca9ca6495 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.533437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.534206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.534562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.534914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.535645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:22.535962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.537580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.550024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 940/1886] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:22.550846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.552633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.565728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f3e66-3987-48db-a3c6-ac56e5ad5a94 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.570579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.571225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.571514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.571801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.572522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:22.572831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.574453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.590230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 941/1887] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:22.590230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.590230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.596849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.598893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.602437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4228-16b5-4649-8068-a0c7e655cbca admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.607047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.607928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.608221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.608499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] PATH_INFO: `/v3/projects/3a1cd3f76e4a48099ca470f7f4cd8955/users/327f20f788694ca4ada0b72dd9ffefdf/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.608926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 947/1888] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:22.609795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.610733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cd3f76e4a48099ca470f7f4cd8955, user_id=327f20f788694ca4ada0b72dd9ffefdf, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.611056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.613345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.624897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615be71-d49b-4937-9682-386069d8d70f service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.626316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 942/1889] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:22 2022] PUT /identity/v3/projects/3a1cd3f76e4a48099ca470f7f4cd8955/users/327f20f788694ca4ada0b72dd9ffefdf/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:22.634039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.693552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.694506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.694880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.695277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] PATH_INFO: `/v3/users/f46b1e59adf748f5adb002f387e3af36` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.696525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46b1e59adf748f5adb002f387e3af36)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.698810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.713283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e013b-b7aa-408a-99e6-a79e7634919b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.719020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.719687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.720268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.720536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.721236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.727281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.739667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:22.755833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46b1e59adf748f5adb002f387e3af36'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.756795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46b1e59adf748f5adb002f387e3af36'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.759630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 943/1890] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:22.760337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.763910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.767311 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46b1e59adf748f5adb002f387e3af36'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.773398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:22.788266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46b1e59adf748f5adb002f387e3af36'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.789356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9122f361-7838-4e25-9714-1d44c8432e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46b1e59adf748f5adb002f387e3af36'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:22.802222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 948/1891] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:22 2022] DELETE /identity/v3/users/f46b1e59adf748f5adb002f387e3af36 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:22.803585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.803879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.804154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.841929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] MFA Rules not processed for user `327f20f788694ca4ada0b72dd9ffefdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:22.843983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.871053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ab2b-fb2e-4a77-89eb-7ba68d035b7c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.949630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 949/1892] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:22.951903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:22.958559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:22.959721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.961302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.961888 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.962368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.963137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.965251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:22.985204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3c684-bea0-47a2-bb13-6777ecba6664 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:22.992628 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:22.993631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:22.993913 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:22.994191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] PATH_INFO: `/v3/users/0ced1c870ba54a8b80900ffd3b0fd33e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:22.995418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ced1c870ba54a8b80900ffd3b0fd33e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:22.997344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.000734 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 944/1893] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:22 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:23.001634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.004545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.059937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ced1c870ba54a8b80900ffd3b0fd33e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.060647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ced1c870ba54a8b80900ffd3b0fd33e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.071537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ced1c870ba54a8b80900ffd3b0fd33e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.089801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ced1c870ba54a8b80900ffd3b0fd33e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.090771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ced1c870ba54a8b80900ffd3b0fd33e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.092190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7ac2d-d7d9-499f-bc19-e0af41cca277 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.102012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.102699 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.102989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.103270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.104012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.106516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.107306 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 950/1894] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:22 2022] DELETE /identity/v3/users/0ced1c870ba54a8b80900ffd3b0fd33e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:23.108121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.109447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.120762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:23.136593 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 945/1895] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:23 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:23.136593 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.138536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.153421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b75337-dd22-40d8-9932-2d672f8e3279 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.182360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5276-3f4f-4216-a723-a04dd1fee08e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.186177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.186833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.187384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.187384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.187999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:23.189780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.227822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144c321-95fc-429e-9cb0-dfd9dc720211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.228499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c321-95fc-429e-9cb0-dfd9dc720211 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.228781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c321-95fc-429e-9cb0-dfd9dc720211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.229060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c321-95fc-429e-9cb0-dfd9dc720211 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.229973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144c321-95fc-429e-9cb0-dfd9dc720211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.231731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144c321-95fc-429e-9cb0-dfd9dc720211 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.254098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 946/1896] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:23 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:23.259191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.259483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.259765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.261694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.263506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.275200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 951/1897] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:23.277176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.278663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.280014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:23.283196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.292580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7110f-e297-49ab-99a2-1115b200a454 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.294821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 947/1898] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:23.295588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.296842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.305031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.306515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.306795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.307080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] PATH_INFO: `/v3/projects/5fb3051341944b4c830a4cfe97ad70b6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.308345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb3051341944b4c830a4cfe97ad70b6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.308885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17acb0-a6e7-459d-ac1a-ec5dd5dc08d5 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.310314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.315565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.316447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.316830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.317205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.318570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.321114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.336327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 948/1899] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:23.336327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.346001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a765c2e-ad5c-4c11-84c3-948ac52abf6d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.353094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.353835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.354121 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.354402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.355141 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.357108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.370496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 949/1900] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:23.370496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.370496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.374342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb3051341944b4c830a4cfe97ad70b6', 'request_id': 'req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.383259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb3051341944b4c830a4cfe97ad70b6', 'request_id': 'req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.389700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb3051341944b4c830a4cfe97ad70b6', 'request_id': 'req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.400648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] The token cache is being invalidate because project 5fb3051341944b4c830a4cfe97ad70b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:23.400932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.401631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:23.403183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 952/1901] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:23 2022] DELETE /identity/v3/projects/5fb3051341944b4c830a4cfe97ad70b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:23.404020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.405307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.431810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a290e5-d594-45b8-ad31-7f2d6462ac7d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.447594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:23.472469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9ccc-59ae-4bfc-88d0-7f5f3b9acea7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.477762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.478433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.478719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.479002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.479727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.481324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.482517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.483081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.483376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.483653 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.485446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.491244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 953/1902] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:23.492038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.493648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.498130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.499978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.506038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11f05-2704-4c4a-bbfd-a24ce8e08297 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.511464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe5a1-12fb-4825-bc16-f45f665cea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.511874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 950/1903] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:23.512157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe5a1-12fb-4825-bc16-f45f665cea1e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.512448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe5a1-12fb-4825-bc16-f45f665cea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.512702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.512802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe5a1-12fb-4825-bc16-f45f665cea1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.513587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fe5a1-12fb-4825-bc16-f45f665cea1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.514382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.515178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fe5a1-12fb-4825-bc16-f45f665cea1e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.532679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 954/1904] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:23.534567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d1052-a67f-43e6-9a1b-f7f2416d3172 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.534874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d1052-a67f-43e6-9a1b-f7f2416d3172 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.548654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d1052-a67f-43e6-9a1b-f7f2416d3172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.582491 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-916d1052-a67f-43e6-9a1b-f7f2416d3172 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:23.584556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-916d1052-a67f-43e6-9a1b-f7f2416d3172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.594036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:23.596570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 955/1905] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:23.597924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d1052-a67f-43e6-9a1b-f7f2416d3172 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.599897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd66be-31cf-41cd-aca3-2d43e58bcabe service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.614517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d1052-a67f-43e6-9a1b-f7f2416d3172 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.615130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c5e60-72c7-475d-ba09-0699d1d98622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.617550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c5e60-72c7-475d-ba09-0699d1d98622 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.617947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c5e60-72c7-475d-ba09-0699d1d98622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.619031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c5e60-72c7-475d-ba09-0699d1d98622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.621178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c99c5e60-72c7-475d-ba09-0699d1d98622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.625355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.626292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.626632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.626908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] PATH_INFO: `/v3/projects/0342a6ee2342471d98db83714750dfc7/users/a617b5d783b241dcaa95ab58c7bb4ed3/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.674710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0342a6ee2342471d98db83714750dfc7, user_id=a617b5d783b241dcaa95ab58c7bb4ed3, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.677532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.701686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 956/1906] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:23 2022] PUT /identity/v3/projects/0342a6ee2342471d98db83714750dfc7/users/a617b5d783b241dcaa95ab58c7bb4ed3/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:23.701686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.712584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c5e60-72c7-475d-ba09-0699d1d98622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.714252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c5e60-72c7-475d-ba09-0699d1d98622 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.725304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 951/1907] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:23.726831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad3e2-6cdc-4dbc-b599-ae30b22b81be None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.727124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad3e2-6cdc-4dbc-b599-ae30b22b81be None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.727406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad3e2-6cdc-4dbc-b599-ae30b22b81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.747068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8abad3e2-6cdc-4dbc-b599-ae30b22b81be None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:23.748310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8abad3e2-6cdc-4dbc-b599-ae30b22b81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:23.854429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad296a3-57a1-44f3-812b-1a500dc98aab admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:23.866532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 952/1908] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:23.868938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329736-0bef-404e-b59e-5e64a3f3a297 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.869621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329736-0bef-404e-b59e-5e64a3f3a297 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.870779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329736-0bef-404e-b59e-5e64a3f3a297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.874468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:23.875921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:23.876912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:23.878093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] PATH_INFO: `/v3/projects/d90c520bcbe44bf59638d8abd2b9b767/users/26be43e2c7d342a19e5654530ff3fe56/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:23.916677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90c520bcbe44bf59638d8abd2b9b767, user_id=26be43e2c7d342a19e5654530ff3fe56, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:23.919598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:23.940879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 957/1909] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:23 2022] PUT /identity/v3/projects/d90c520bcbe44bf59638d8abd2b9b767/users/26be43e2c7d342a19e5654530ff3fe56/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:23.950094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:23.969279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a0329736-0bef-404e-b59e-5e64a3f3a297 None None] MFA Rules not processed for user `a617b5d783b241dcaa95ab58c7bb4ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:23.972062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a0329736-0bef-404e-b59e-5e64a3f3a297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.159037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d59e-7bc2-4e9d-a1fd-2b4587aa7d4f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.165976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.166737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.167025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.167301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.168490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:24.168878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.171123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.196328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 958/1910] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:24.197568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.199608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.209875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 953/1911] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:24.212316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466edb-93c7-4c2b-a2b9-99606ebbb502 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.212608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466edb-93c7-4c2b-a2b9-99606ebbb502 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.213291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466edb-93c7-4c2b-a2b9-99606ebbb502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.216418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326eb9-31b6-4df8-ad16-f08ea617ad13 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.222374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.223432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.223719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.224005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] PATH_INFO: `/v3/projects/95932f3c092e4c34b92a549ff6233537` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.225213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95932f3c092e4c34b92a549ff6233537)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.228457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.241020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:24.243035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-77466edb-93c7-4c2b-a2b9-99606ebbb502 None None] MFA Rules not processed for user `26be43e2c7d342a19e5654530ff3fe56`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:24.244677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-77466edb-93c7-4c2b-a2b9-99606ebbb502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.273877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:24.303844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95932f3c092e4c34b92a549ff6233537', 'request_id': 'req-81f52a75-b9b3-4577-825e-845fb5ee4375'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.325049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95932f3c092e4c34b92a549ff6233537', 'request_id': 'req-81f52a75-b9b3-4577-825e-845fb5ee4375'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.333686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95932f3c092e4c34b92a549ff6233537', 'request_id': 'req-81f52a75-b9b3-4577-825e-845fb5ee4375'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.350235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 954/1912] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:24.350648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] The token cache is being invalidate because project 95932f3c092e4c34b92a549ff6233537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:24.350941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.352008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77466edb-93c7-4c2b-a2b9-99606ebbb502 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.352272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.356879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 959/1913] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:24 2022] DELETE /identity/v3/projects/95932f3c092e4c34b92a549ff6233537 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:24.358229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.360039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.370068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77466edb-93c7-4c2b-a2b9-99606ebbb502 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.440153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.440331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52a75-b9b3-4577-825e-845fb5ee4375 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.440811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.441092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.441363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.442090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.444132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.446095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.447106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.447562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.447927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] PATH_INFO: `/v3/users/36a41b3046ac449db696a302bba08df1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.450349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a41b3046ac449db696a302bba08df1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.452733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.475815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 955/1914] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:24 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:24.477930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.480887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.506664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a41b3046ac449db696a302bba08df1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.514116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a41b3046ac449db696a302bba08df1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.526572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a41b3046ac449db696a302bba08df1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.540888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a41b3046ac449db696a302bba08df1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.541738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a41b3046ac449db696a302bba08df1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.555670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 960/1915] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:24 2022] DELETE /identity/v3/users/36a41b3046ac449db696a302bba08df1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:24.559380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.560872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.562799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424f7db-9394-4423-9086-69626d7f38f4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.575983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:24.622529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:24.630541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.631196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.631482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.631754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.631864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf966-2d53-4df3-ae73-a2e9ec840381 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.632465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.634519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.636685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.637589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.637885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.638165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] PATH_INFO: `/v3/users/4ac66a46225e40578bef03ef3ed9795e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.639368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac66a46225e40578bef03ef3ed9795e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.641280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.663464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 956/1916] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:24 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:24.663464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.663464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.690937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac66a46225e40578bef03ef3ed9795e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.691593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac66a46225e40578bef03ef3ed9795e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.700103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac66a46225e40578bef03ef3ed9795e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.714406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac66a46225e40578bef03ef3ed9795e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.715278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac66a46225e40578bef03ef3ed9795e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.723611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3a560-e0ba-48a9-8c22-26b517a5fdb2 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.728359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 961/1917] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:24 2022] DELETE /identity/v3/users/4ac66a46225e40578bef03ef3ed9795e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:24.728481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d22e0a-581c-4ba8-8e04-7aafdd984259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.729074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22e0a-581c-4ba8-8e04-7aafdd984259 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.729260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.729365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22e0a-581c-4ba8-8e04-7aafdd984259 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.729753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22e0a-581c-4ba8-8e04-7aafdd984259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.730816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.731678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-75d22e0a-581c-4ba8-8e04-7aafdd984259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.799486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b16fc6-a29f-48be-9e0d-b9c5feeb6437 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.805164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.805828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.806112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.806389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.806835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d22e0a-581c-4ba8-8e04-7aafdd984259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.807080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.808763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d22e0a-581c-4ba8-8e04-7aafdd984259 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.809008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.821963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 957/1918] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:24.824055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83adf1d-1bcf-4ff2-a360-c905189a7dea None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.824675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83adf1d-1bcf-4ff2-a360-c905189a7dea None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.825156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83adf1d-1bcf-4ff2-a360-c905189a7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.830521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 962/1919] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:24 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:24.834056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.834056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.850988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f690-541e-45d4-acc7-61c9a70c837f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.852423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f83adf1d-1bcf-4ff2-a360-c905189a7dea None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:24.853913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f83adf1d-1bcf-4ff2-a360-c905189a7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.856588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.857741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.857865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.858169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.858863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.860852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.866142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 958/1920] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:24.866142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83adf1d-1bcf-4ff2-a360-c905189a7dea None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.879506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83adf1d-1bcf-4ff2-a360-c905189a7dea None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.883688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 963/1921] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:24 2022] POST /identity/v3/users => generated 308 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:24.885253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.887309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.888812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.889539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.889831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.890288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.891052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.892725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.900546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=7 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:24.906809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d724a8-4c3f-49c3-8362-4745016fcd96 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:24.910056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 959/1922] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:24.911090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:24.912865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:24.917303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:24.918613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:24.919006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:24.919473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] PATH_INFO: `/v3/users/26be43e2c7d342a19e5654530ff3fe56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:24.920815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26be43e2c7d342a19e5654530ff3fe56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:24.922974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:24.991604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26be43e2c7d342a19e5654530ff3fe56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.992049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26be43e2c7d342a19e5654530ff3fe56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:24.996722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a4e93-3f97-4944-9eeb-c3db43d24229 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.002009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.004998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26be43e2c7d342a19e5654530ff3fe56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.006173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.006870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.007921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.010985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.031438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.032390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26be43e2c7d342a19e5654530ff3fe56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.033068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.033433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26be43e2c7d342a19e5654530ff3fe56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.045512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 960/1923] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:25.046366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.047901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.057257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 964/1924] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:24 2022] DELETE /identity/v3/users/26be43e2c7d342a19e5654530ff3fe56 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:25.058319 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.059942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.064821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c28c95-49df-46b8-bc9e-b85066990376 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.088193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:25.155514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f968-8b1a-44b8-a391-ea1b6cd11776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.156469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f968-8b1a-44b8-a391-ea1b6cd11776 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.157340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f968-8b1a-44b8-a391-ea1b6cd11776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.157815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f968-8b1a-44b8-a391-ea1b6cd11776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.159563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f968-8b1a-44b8-a391-ea1b6cd11776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.161549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f968-8b1a-44b8-a391-ea1b6cd11776 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.168810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274a9b4-7889-4356-896a-cffdf2402429 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.175885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 961/1925] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:25.177619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14616d6c-c859-451c-934e-756f6e80c884 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.178046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14616d6c-c859-451c-934e-756f6e80c884 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.178545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14616d6c-c859-451c-934e-756f6e80c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.179830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.181082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.181530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.181822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.183472 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.186507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.206992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 965/1926] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:25.206992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.207252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-14616d6c-c859-451c-934e-756f6e80c884 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:25.208373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-14616d6c-c859-451c-934e-756f6e80c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.211041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.220909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 962/1927] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:25.220909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14616d6c-c859-451c-934e-756f6e80c884 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.231158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14616d6c-c859-451c-934e-756f6e80c884 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.233370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85654f0-b102-42ee-ab5c-707f8b999404 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.237824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.238803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.239164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.239515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] PATH_INFO: `/v3/projects/6002e21c695746aba1d1ea9cdd905996/users/26f29b7f40c0486086caf365cbfb85b5/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.241227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.243986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.245821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.246181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] PATH_INFO: `/v3/projects/05833e5d3d7948ac86bb311451cae8a3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.247526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05833e5d3d7948ac86bb311451cae8a3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.249489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.263943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6002e21c695746aba1d1ea9cdd905996, user_id=26f29b7f40c0486086caf365cbfb85b5, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.266649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.281703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 963/1928] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:25 2022] PUT /identity/v3/projects/6002e21c695746aba1d1ea9cdd905996/users/26f29b7f40c0486086caf365cbfb85b5/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:25.282847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.319501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05833e5d3d7948ac86bb311451cae8a3', 'request_id': 'req-a02065fb-946e-40a0-8af3-78d8419e9d11'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.332073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05833e5d3d7948ac86bb311451cae8a3', 'request_id': 'req-a02065fb-946e-40a0-8af3-78d8419e9d11'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.352534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05833e5d3d7948ac86bb311451cae8a3', 'request_id': 'req-a02065fb-946e-40a0-8af3-78d8419e9d11'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.370765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:25.387947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] The token cache is being invalidate because project 05833e5d3d7948ac86bb311451cae8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:25.388716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6d549-0f51-4887-80f4-344cf0d0d681 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.389072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.390415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.394043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 966/1929] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:25 2022] DELETE /identity/v3/projects/05833e5d3d7948ac86bb311451cae8a3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:25.396028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.398291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.477815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02065fb-946e-40a0-8af3-78d8419e9d11 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.478546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.479947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.480369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.480867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] PATH_INFO: `/v3/projects/dd5f4016d8dc41e4995da741eb5d53f8/users/b89bb46a6c9f4ee29e1cb96db20387c1/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.486392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be954b-4beb-445f-9766-ce16269dbf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.486978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be954b-4beb-445f-9766-ce16269dbf18 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.487268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be954b-4beb-445f-9766-ce16269dbf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.487548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be954b-4beb-445f-9766-ce16269dbf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.490238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-25be954b-4beb-445f-9766-ce16269dbf18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.499812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5f4016d8dc41e4995da741eb5d53f8, user_id=b89bb46a6c9f4ee29e1cb96db20387c1, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.503106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.508295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be954b-4beb-445f-9766-ce16269dbf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.510595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be954b-4beb-445f-9766-ce16269dbf18 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.524410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 964/1930] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:25 2022] PUT /identity/v3/projects/dd5f4016d8dc41e4995da741eb5d53f8/users/b89bb46a6c9f4ee29e1cb96db20387c1/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:25.525908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 967/1931] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:25.527383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.527841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.528225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.528917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.530887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.555194 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:25.573592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:25.575395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.634996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc38c7a-cb74-4a1f-97f4-aabe1d8aa9f8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.641704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c513-de21-4432-8615-59d2b2193449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.642836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c513-de21-4432-8615-59d2b2193449 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.643126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c513-de21-4432-8615-59d2b2193449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.643512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c513-de21-4432-8615-59d2b2193449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.644393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c513-de21-4432-8615-59d2b2193449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.646908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c513-de21-4432-8615-59d2b2193449 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.657519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 965/1932] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:25.658805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b577-7b61-44f1-85b5-aa6d29b102d7 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.659098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b577-7b61-44f1-85b5-aa6d29b102d7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.659387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b577-7b61-44f1-85b5-aa6d29b102d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.668052 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 968/1933] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:25.669099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.670382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.681378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-df92b577-7b61-44f1-85b5-aa6d29b102d7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:25.682935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-df92b577-7b61-44f1-85b5-aa6d29b102d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.683328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef57fa3-1347-4d83-a313-957e0a58b851 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.688403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.689410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.689854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.690201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] PATH_INFO: `/v3/projects/d18ac985a29e45049ca72b494de13b83` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.691307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 966/1934] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:25.692264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b577-7b61-44f1-85b5-aa6d29b102d7 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.694294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18ac985a29e45049ca72b494de13b83)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.697044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.703467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b577-7b61-44f1-85b5-aa6d29b102d7 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.708918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b8766-cb6f-483e-913b-4fa5a462d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.710001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b8766-cb6f-483e-913b-4fa5a462d15d admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.710387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b8766-cb6f-483e-913b-4fa5a462d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.710980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b8766-cb6f-483e-913b-4fa5a462d15d admin admin] PATH_INFO: `/v3/projects/6002e21c695746aba1d1ea9cdd905996/users/26f29b7f40c0486086caf365cbfb85b5/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.712730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b8766-cb6f-483e-913b-4fa5a462d15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6002e21c695746aba1d1ea9cdd905996, user_id=26f29b7f40c0486086caf365cbfb85b5, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.715977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b8766-cb6f-483e-913b-4fa5a462d15d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.747060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 967/1935] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:25 2022] PUT /identity/v3/projects/6002e21c695746aba1d1ea9cdd905996/users/26f29b7f40c0486086caf365cbfb85b5/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:25.748725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bff30-fcdc-443f-8bc4-e666a84deedd None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.749023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bff30-fcdc-443f-8bc4-e666a84deedd None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.749304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bff30-fcdc-443f-8bc4-e666a84deedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.759923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18ac985a29e45049ca72b494de13b83', 'request_id': 'req-fadb1642-128d-4ba7-87f8-312face62429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.768742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ca3bff30-fcdc-443f-8bc4-e666a84deedd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:25.770218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18ac985a29e45049ca72b494de13b83', 'request_id': 'req-fadb1642-128d-4ba7-87f8-312face62429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.770364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ca3bff30-fcdc-443f-8bc4-e666a84deedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.777924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18ac985a29e45049ca72b494de13b83', 'request_id': 'req-fadb1642-128d-4ba7-87f8-312face62429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.790489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] The token cache is being invalidate because project d18ac985a29e45049ca72b494de13b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:25.790780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.791481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:25.793409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 969/1936] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:25 2022] DELETE /identity/v3/projects/d18ac985a29e45049ca72b494de13b83 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:25.794424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.796885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.829639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:25.847152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 968/1937] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:25.848866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62502e-5187-4655-9816-2d456913ee2a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.849253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62502e-5187-4655-9816-2d456913ee2a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.854054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62502e-5187-4655-9816-2d456913ee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.876900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1642-128d-4ba7-87f8-312face62429 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.881035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.881800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.882161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.882494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.884401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.886076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0e62502e-5187-4655-9816-2d456913ee2a None None] MFA Rules not processed for user `26f29b7f40c0486086caf365cbfb85b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:25.887850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0e62502e-5187-4655-9816-2d456913ee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.897326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.899407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:25.909921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 970/1938] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:25.910781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:25.912123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:25.924948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75bc47-a364-4302-b866-bb76727d8cb2 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:25.930611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:25.931364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:25.931807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:25.931924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] PATH_INFO: `/v3/users/327f20f788694ca4ada0b72dd9ffefdf` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:25.933225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327f20f788694ca4ada0b72dd9ffefdf)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:25.935242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.000308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327f20f788694ca4ada0b72dd9ffefdf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.001374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327f20f788694ca4ada0b72dd9ffefdf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.007620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 969/1939] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:26.008472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62502e-5187-4655-9816-2d456913ee2a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.021647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62502e-5187-4655-9816-2d456913ee2a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.028724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.029924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.030449 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.030747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.031790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:26.032031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327f20f788694ca4ada0b72dd9ffefdf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.032346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.034345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.047173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327f20f788694ca4ada0b72dd9ffefdf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.047896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327f20f788694ca4ada0b72dd9ffefdf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.049867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 970/1940] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:26.050931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.053132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.063124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:26.067662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 971/1941] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:25 2022] DELETE /identity/v3/users/327f20f788694ca4ada0b72dd9ffefdf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:26.068878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.069034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992c7ad-6cdb-420e-aa49-8a3c62af4347 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.070621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.154620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.156229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5500ad-1dca-4ce1-aee5-90b147659ff9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.156816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.157113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.157406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] PATH_INFO: `/v3/projects/d90c520bcbe44bf59638d8abd2b9b767` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.159020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90c520bcbe44bf59638d8abd2b9b767)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.161084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.163435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.165481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.165986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.166449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.169847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.240727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:26.241261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90c520bcbe44bf59638d8abd2b9b767', 'request_id': 'req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.271367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90c520bcbe44bf59638d8abd2b9b767', 'request_id': 'req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.285563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.287195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.309759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90c520bcbe44bf59638d8abd2b9b767', 'request_id': 'req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.310425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 972/1942] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:26 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:26.312424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.319184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.349299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefff1c0-e969-48bd-888f-7387f90babf5 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.366647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] The token cache is being invalidate because project d90c520bcbe44bf59638d8abd2b9b767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:26.367013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.375939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6d6ad407-0286-45a2-94ee-55f0cf34f5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.383548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 971/1943] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:26 2022] DELETE /identity/v3/projects/d90c520bcbe44bf59638d8abd2b9b767 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:26.385137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.385503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.385798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.423149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:26.433226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.504508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4af969-6c2f-40a0-9170-5aa5f216e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.505259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af969-6c2f-40a0-9170-5aa5f216e664 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.505616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af969-6c2f-40a0-9170-5aa5f216e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.505905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af969-6c2f-40a0-9170-5aa5f216e664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.507090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4af969-6c2f-40a0-9170-5aa5f216e664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.509321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4af969-6c2f-40a0-9170-5aa5f216e664 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.571854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 972/1944] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:26.582265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 973/1945] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:26 2022] POST /identity/v3/projects => generated 361 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:26.584156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.584460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.584789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.586968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.593418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.609900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:26.611464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.623202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2bde-5775-416a-b891-0dff28419f54 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.720618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 974/1946] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:26.720912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.722521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.727960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:26.736322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012857-6358-4a74-88e2-7d39166ab450 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.741664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.742226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.742520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.742845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.743947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.746501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.772329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 975/1947] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:26 2022] POST /identity/v3/users => generated 281 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:26.774139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.788543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.790357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.790643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.791028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] PATH_INFO: `/v3/users/a617b5d783b241dcaa95ab58c7bb4ed3` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.792316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a617b5d783b241dcaa95ab58c7bb4ed3)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.794354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.796838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52670-dd2b-4671-8d9d-383af78700e3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.802686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.803494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.803786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.804288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.805082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:26.805600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.807384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.830554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 976/1948] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:26.831471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.847600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c3bac-5cce-46f1-a897-62b41e0cf606 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.856220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.857028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.857322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.857757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.858650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.861969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.883156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 977/1949] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:26.883156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.898957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a617b5d783b241dcaa95ab58c7bb4ed3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.899731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742ba7f-5e17-41f8-9201-7936f1205452 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:26.900003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a617b5d783b241dcaa95ab58c7bb4ed3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.907296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:26.908040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:26.908369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:26.908658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:26.909999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:26.913166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:26.931652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a617b5d783b241dcaa95ab58c7bb4ed3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.932684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a617b5d783b241dcaa95ab58c7bb4ed3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.958233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a617b5d783b241dcaa95ab58c7bb4ed3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:26.971033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 978/1950] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:26 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:26.971033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.971939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:26.986603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:26.990248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 973/1951] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:26 2022] DELETE /identity/v3/users/a617b5d783b241dcaa95ab58c7bb4ed3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:26.991348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:26.993015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.061332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676f9a9-17f1-48bb-af39-194ed095e482 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.075677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd01b6-525e-4693-bf37-eee4dc9ce9d0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.078086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda0550-5a8c-40ee-8e32-bcdfb57e3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.079419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda0550-5a8c-40ee-8e32-bcdfb57e3c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.080099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda0550-5a8c-40ee-8e32-bcdfb57e3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.080574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda0550-5a8c-40ee-8e32-bcdfb57e3c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.082198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda0550-5a8c-40ee-8e32-bcdfb57e3c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.082720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.084159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.084533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.085036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.086541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda0550-5a8c-40ee-8e32-bcdfb57e3c97 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.087218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.089702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.099541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 979/1952] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:27.101419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e3f7d-6438-48e2-9c82-a1ed73bab6ee None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.101988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e3f7d-6438-48e2-9c82-a1ed73bab6ee None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.102563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e3f7d-6438-48e2-9c82-a1ed73bab6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.127789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 974/1953] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:26 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:27.129507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.131297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.145431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1a4a-4e87-4cde-91b3-48b24680906e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.153335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.154263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.154545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.154837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] PATH_INFO: `/v3/projects/3a1cd3f76e4a48099ca470f7f4cd8955` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.156257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1cd3f76e4a48099ca470f7f4cd8955)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.159498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.162438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1f0e3f7d-6438-48e2-9c82-a1ed73bab6ee None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:27.163720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f0e3f7d-6438-48e2-9c82-a1ed73bab6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.191027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 980/1954] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:27.192072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e3f7d-6438-48e2-9c82-a1ed73bab6ee None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.218259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e3f7d-6438-48e2-9c82-a1ed73bab6ee None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.226502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.227405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.227687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.227965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] PATH_INFO: `/v3/projects/ab207874c57949698ff22b6a3cd3b176/users/85c492821fbf494f86bce5863ee5188d/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.256326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:27.268216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab207874c57949698ff22b6a3cd3b176, user_id=85c492821fbf494f86bce5863ee5188d, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.270764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1cd3f76e4a48099ca470f7f4cd8955', 'request_id': 'req-4ae58837-bad9-42b4-a97e-8589abf2d124'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:27.271385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.280685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1cd3f76e4a48099ca470f7f4cd8955', 'request_id': 'req-4ae58837-bad9-42b4-a97e-8589abf2d124'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:27.293116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1cd3f76e4a48099ca470f7f4cd8955', 'request_id': 'req-4ae58837-bad9-42b4-a97e-8589abf2d124'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:27.295730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 981/1955] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:27 2022] PUT /identity/v3/projects/ab207874c57949698ff22b6a3cd3b176/users/85c492821fbf494f86bce5863ee5188d/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:27.296922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.307796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] The token cache is being invalidate because project 3a1cd3f76e4a48099ca470f7f4cd8955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:27.308989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:27.309722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4ae58837-bad9-42b4-a97e-8589abf2d124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:27.315798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 975/1956] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:27 2022] DELETE /identity/v3/projects/3a1cd3f76e4a48099ca470f7f4cd8955 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:27.315798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709ecca-4640-4681-81fa-de85e81196c9 None None] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.315798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709ecca-4640-4681-81fa-de85e81196c9 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.315798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709ecca-4640-4681-81fa-de85e81196c9 None None] PATH_INFO: `/` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.317219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 976/1957] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:19:27.326091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709ecca-4640-4681-81fa-de85e81196c9 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.329740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a709ecca-4640-4681-81fa-de85e81196c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.401315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b98932-5f40-4762-9f43-cc1b350b72f6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.408110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90b38c-6a6c-468c-8b7a-7d98c60c5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.408883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b38c-6a6c-468c-8b7a-7d98c60c5689 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.409176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b38c-6a6c-468c-8b7a-7d98c60c5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.409493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b38c-6a6c-468c-8b7a-7d98c60c5689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.410326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90b38c-6a6c-468c-8b7a-7d98c60c5689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.412029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90b38c-6a6c-468c-8b7a-7d98c60c5689 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.446569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 982/1958] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:27.449321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332487a2-e15f-45b0-8719-2a6929616f20 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.450412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332487a2-e15f-45b0-8719-2a6929616f20 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.450882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332487a2-e15f-45b0-8719-2a6929616f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.483635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709ecca-4640-4681-81fa-de85e81196c9 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.493807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-332487a2-e15f-45b0-8719-2a6929616f20 None None] MFA Rules not processed for user `85c492821fbf494f86bce5863ee5188d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:27.495774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-332487a2-e15f-45b0-8719-2a6929616f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.496099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba2b5-f06a-40b4-abde-43ec156abc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.496777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba2b5-f06a-40b4-abde-43ec156abc07 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.497070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba2b5-f06a-40b4-abde-43ec156abc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.497358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba2b5-f06a-40b4-abde-43ec156abc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.502726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d24ba2b5-f06a-40b4-abde-43ec156abc07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.537726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba2b5-f06a-40b4-abde-43ec156abc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.540978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba2b5-f06a-40b4-abde-43ec156abc07 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.566131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 977/1959] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:27.567386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.567777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.568156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.601975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:27.608439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:27.608807 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.618975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 983/1960] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:27.621208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36ff79-5509-4c68-ac33-1998f3ce03e3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.621609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36ff79-5509-4c68-ac33-1998f3ce03e3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.622157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36ff79-5509-4c68-ac33-1998f3ce03e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.635886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 978/1961] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:27.637226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.640129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.660173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7e36ff79-5509-4c68-ac33-1998f3ce03e3 None None] MFA Rules not processed for user `1fe6b95088494836b8598ea8f33d5167`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:27.663613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7e36ff79-5509-4c68-ac33-1998f3ce03e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.671938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c6b25-36d2-4fc7-8422-32c65d48cb74 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.683885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc452b0-e71e-4d3c-9eb8-7d5e13661e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.684695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc452b0-e71e-4d3c-9eb8-7d5e13661e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.685150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc452b0-e71e-4d3c-9eb8-7d5e13661e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.685945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc452b0-e71e-4d3c-9eb8-7d5e13661e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.686508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc452b0-e71e-4d3c-9eb8-7d5e13661e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.689169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc452b0-e71e-4d3c-9eb8-7d5e13661e25 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.709698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 979/1962] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:27.711455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c4db-6f67-4bd0-bbde-fdf3dd3b7623 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.711647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c4db-6f67-4bd0-bbde-fdf3dd3b7623 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.712499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c4db-6f67-4bd0-bbde-fdf3dd3b7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.783477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 984/1963] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:27.783685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4476c4db-6f67-4bd0-bbde-fdf3dd3b7623 None None] MFA Rules not processed for user `b89bb46a6c9f4ee29e1cb96db20387c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:27.784933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4476c4db-6f67-4bd0-bbde-fdf3dd3b7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.785103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.785489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.785932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.829257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:27.832302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.848198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 985/1964] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:27.849621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.852408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.917442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 980/1965] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:27.919914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c4db-6f67-4bd0-bbde-fdf3dd3b7623 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.934832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c4db-6f67-4bd0-bbde-fdf3dd3b7623 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.939603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.940500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.940786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.941171 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] PATH_INFO: `/v3/projects/b1039b51b8b24694a3650a87e8a4d4eb/users/018119c0b37347e7a5e6876d82404a14/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.959138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde3a3-ffe2-43f7-a41d-45ca1be85449 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:27.959759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1039b51b8b24694a3650a87e8a4d4eb, user_id=018119c0b37347e7a5e6876d82404a14, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.962828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.963033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:27.963641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:27.963932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:27.964200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:27.977853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:27.979727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:27.993256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 981/1966] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:27 2022] PUT /identity/v3/projects/b1039b51b8b24694a3650a87e8a4d4eb/users/018119c0b37347e7a5e6876d82404a14/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:27.993256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:27.994853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 986/1967] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:27.994967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:27.995706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.022840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e618d-7b1e-41b2-bb6a-56420ca900f5 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.024142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:28.114942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.115715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.116035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.116327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.117708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:28.118015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.119617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.120598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca4aa-5d90-43c4-857f-68433aa914c1 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.128531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3118e-c212-49d5-ae9e-7a2dd4b455fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.129337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3118e-c212-49d5-ae9e-7a2dd4b455fc service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.129672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3118e-c212-49d5-ae9e-7a2dd4b455fc service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.129952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3118e-c212-49d5-ae9e-7a2dd4b455fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.140950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3118e-c212-49d5-ae9e-7a2dd4b455fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.142607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3118e-c212-49d5-ae9e-7a2dd4b455fc service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.143659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 987/1968] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:28.144640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.146496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.159817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 982/1969] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:28.161442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35ce1-0bd4-4316-addd-0629f9e7694d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.161989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35ce1-0bd4-4316-addd-0629f9e7694d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.162099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35ce1-0bd4-4316-addd-0629f9e7694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.168563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c336611-e3c9-44bd-a0ae-0c35c9ad2ae7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.183129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.183815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.184091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.184373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.185078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.187030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.211457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:28.212444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f3b35ce1-0bd4-4316-addd-0629f9e7694d None None] MFA Rules not processed for user `018119c0b37347e7a5e6876d82404a14`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:28.213920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f3b35ce1-0bd4-4316-addd-0629f9e7694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.222798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 988/1970] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:28.223669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.225829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.333660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18409d-bb85-4e9d-8afd-9c4328933178 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.340342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 983/1971] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:28.341306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35ce1-0bd4-4316-addd-0629f9e7694d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.347031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.348074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.350136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.350136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] PATH_INFO: `/v3/users/85c492821fbf494f86bce5863ee5188d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.352471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c492821fbf494f86bce5863ee5188d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.356573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.360222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35ce1-0bd4-4316-addd-0629f9e7694d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.366338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.367561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.367847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.369940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.369940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.370857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.406152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 984/1972] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:28.406152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.416356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c492821fbf494f86bce5863ee5188d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.417132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c492821fbf494f86bce5863ee5188d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.430259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c492821fbf494f86bce5863ee5188d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.467318 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c492821fbf494f86bce5863ee5188d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.468061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c492821fbf494f86bce5863ee5188d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.485193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 989/1973] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:28 2022] DELETE /identity/v3/users/85c492821fbf494f86bce5863ee5188d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:28.486515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.490557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.493541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e3c2-cdca-4562-b94e-9ca8f7ea5ee8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.511169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:28.562250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.563015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.563377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.563772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.564540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.567010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.588481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b713f-f8e1-4931-819c-7df7fc3a1bdb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.589454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 985/1974] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:28.590329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.592212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.596694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.597601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.597884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.598158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] PATH_INFO: `/v3/projects/0342a6ee2342471d98db83714750dfc7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.599515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0342a6ee2342471d98db83714750dfc7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.602657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.614411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60569652-36b3-4f6f-bb2b-f7ac802c1c3a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.623404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.623837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.624130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.624407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.625583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.627668 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.659580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:28.689387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 986/1975] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:28.690753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.693242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.704711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0342a6ee2342471d98db83714750dfc7', 'request_id': 'req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.720243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0342a6ee2342471d98db83714750dfc7', 'request_id': 'req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.732938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0342a6ee2342471d98db83714750dfc7', 'request_id': 'req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.752117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] The token cache is being invalidate because project 0342a6ee2342471d98db83714750dfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:28.752412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.753105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d56eec9b-fff9-43f1-9628-7c156f2b4c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.755923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 990/1976] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:28 2022] DELETE /identity/v3/projects/0342a6ee2342471d98db83714750dfc7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:28.757362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.757679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.758099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.779214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783e1d-faa3-4ccb-8dce-4b255b214b21 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.783973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:28.785348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.789472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.790383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.790737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.791084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.791852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.797570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 991/1977] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:28.797570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.797845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.798838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.824610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd9fe0-2a88-4e78-9444-8a5a66b3473a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.830866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.837829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.837829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.837829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.837829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.838378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 987/1978] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:28.838469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.838549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.841853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.856008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9da152-636b-49f3-97b2-6f92dba990ff admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.861507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 992/1979] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:28.861507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.864863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.865986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.866483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.867372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.867985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.869178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.871656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.885952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2a942-eaa6-4b4f-9086-94082e776e55 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.893016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.893953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.894244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.894613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] PATH_INFO: `/v3/users/26f29b7f40c0486086caf365cbfb85b5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.896046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f29b7f40c0486086caf365cbfb85b5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.898554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:28.901293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 988/1980] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:28 2022] POST /identity/v3/users => generated 293 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:28.902255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:28.904322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.956132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f29b7f40c0486086caf365cbfb85b5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.956943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f29b7f40c0486086caf365cbfb85b5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.967422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f29b7f40c0486086caf365cbfb85b5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.971505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f172600-b143-4957-a07d-4f6d03274f77 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:28.975471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:28.976770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:28.977136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:28.977646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:28.979952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:28.985796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f29b7f40c0486086caf365cbfb85b5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.986551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f29b7f40c0486086caf365cbfb85b5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:28.993880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:28.995399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.001666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:29.002267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 993/1981] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:28 2022] DELETE /identity/v3/users/26f29b7f40c0486086caf365cbfb85b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:29.003189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.004897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.013069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 989/1982] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:29.014061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.016661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.030152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1647c4-53af-4d5f-9172-6cae439ab882 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.091656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4e17-8afc-410e-aba6-c7c12f4b84c1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.098191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.098766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.099151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.099562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.100440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.103254 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.109145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:29.115203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 994/1983] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:29.116251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.118344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.130428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.131831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.132124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.132639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] PATH_INFO: `/v3/projects/acc21823ea104815a0cb9488515a8676/users/15b5f15066094c77995edbeaba76865c/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.135759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009586-66ae-4eb6-8be5-c75e408a088c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.140829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.141712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.142076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.142433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.143242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.144965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.156732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 995/1984] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:29.157169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc21823ea104815a0cb9488515a8676, user_id=15b5f15066094c77995edbeaba76865c, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.157796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.160376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.169898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6703d2-86c4-4c6b-aa35-4c64af6dd8a0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.176980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.177782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.181960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 990/1985] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:29 2022] PUT /identity/v3/projects/acc21823ea104815a0cb9488515a8676/users/15b5f15066094c77995edbeaba76865c/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:29.182130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.182130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.182272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.182343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.182343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.197211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 996/1986] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:29.197937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.211503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d7503-5ae5-4807-8ac4-37e764e21185 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.257123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ec767-9420-4a4b-9001-ada6d22f6497 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.263304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.263955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.264244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.264521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.265251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.267045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.278728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 991/1987] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:29.279813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.280297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.281070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.281409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.281753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.282521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.284145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.299922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 997/1988] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:29.299922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.308898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b912490-c06b-4339-916c-2dcef7f36b11 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.316476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7c625-1c9a-4b19-9e97-7f3e4e05b019 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.322279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.323816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.324131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.324571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] PATH_INFO: `/v3/projects/540c3c8b72244c8a8f99872262b4d80b/users/0e8cd4f401bc4190beb165166f9d59b9/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.324674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff7fa-5cb0-4351-8c8f-a594252b63b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.325677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff7fa-5cb0-4351-8c8f-a594252b63b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.325970 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff7fa-5cb0-4351-8c8f-a594252b63b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.326251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff7fa-5cb0-4351-8c8f-a594252b63b2 admin admin] PATH_INFO: `/v3/projects/a2180511eb5548468cb9941800c8a2b8/users/71ba605b79df4c3b99839f1d171f72c9/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.341702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=540c3c8b72244c8a8f99872262b4d80b, user_id=0e8cd4f401bc4190beb165166f9d59b9, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.344373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.357850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff7fa-5cb0-4351-8c8f-a594252b63b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2180511eb5548468cb9941800c8a2b8, user_id=71ba605b79df4c3b99839f1d171f72c9, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.361093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff7fa-5cb0-4351-8c8f-a594252b63b2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.362235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 992/1989] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:29 2022] PUT /identity/v3/projects/540c3c8b72244c8a8f99872262b4d80b/users/0e8cd4f401bc4190beb165166f9d59b9/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:29.363169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.385559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 998/1990] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:29 2022] PUT /identity/v3/projects/a2180511eb5548468cb9941800c8a2b8/users/71ba605b79df4c3b99839f1d171f72c9/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:29.388204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ff91-20f6-446e-9cea-0956378086e7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.388880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ff91-20f6-446e-9cea-0956378086e7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.389502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ff91-20f6-446e-9cea-0956378086e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.419445 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0507ff91-20f6-446e-9cea-0956378086e7 None None] MFA Rules not processed for user `0e8cd4f401bc4190beb165166f9d59b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:29.420924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0507ff91-20f6-446e-9cea-0956378086e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.430838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:29.438147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e487817-b070-4fc7-82a6-9221fc6cb005 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.503509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 999/1991] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:29.505640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6775-79a5-4713-b754-5181176c1121 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.505761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.505954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6775-79a5-4713-b754-5181176c1121 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.506249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6775-79a5-4713-b754-5181176c1121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.506680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.507167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.507795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] PATH_INFO: `/v3/projects/acc21823ea104815a0cb9488515a8676/users/15b5f15066094c77995edbeaba76865c/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.509911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc21823ea104815a0cb9488515a8676, user_id=15b5f15066094c77995edbeaba76865c, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.512569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.529500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 993/1992] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:29 2022] PUT /identity/v3/projects/acc21823ea104815a0cb9488515a8676/users/15b5f15066094c77995edbeaba76865c/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:29.529777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.545111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-101d6775-79a5-4713-b754-5181176c1121 None None] MFA Rules not processed for user `71ba605b79df4c3b99839f1d171f72c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:29.547119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-101d6775-79a5-4713-b754-5181176c1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.588795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:29.627245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e32bf2-8c73-4df3-a92c-41eae243fc5f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.634908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.635613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.635853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.636128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.636823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.638763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.674700 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1000/1993] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:29.675808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6775-79a5-4713-b754-5181176c1121 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.677749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-101d6775-79a5-4713-b754-5181176c1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.690790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 994/1994] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:29 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:29.691779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.693599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.698102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6775-79a5-4713-b754-5181176c1121 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.772723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.773639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.773922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.774197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] PATH_INFO: `/v3/projects/ab207874c57949698ff22b6a3cd3b176` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.775384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab207874c57949698ff22b6a3cd3b176)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.777328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.805793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01328-19b1-44bf-9eec-c8ed386a2612 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.811163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:29.812082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:29.812361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:29.812637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] PATH_INFO: `/v3/projects/6002e21c695746aba1d1ea9cdd905996` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:29.814044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6002e21c695746aba1d1ea9cdd905996)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:29.815951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:29.838548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab207874c57949698ff22b6a3cd3b176', 'request_id': 'req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.848315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:29.849045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab207874c57949698ff22b6a3cd3b176', 'request_id': 'req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.856368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab207874c57949698ff22b6a3cd3b176', 'request_id': 'req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.874601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] The token cache is being invalidate because project ab207874c57949698ff22b6a3cd3b176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:29.874896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.875575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.882006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1001/1995] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:29 2022] DELETE /identity/v3/projects/ab207874c57949698ff22b6a3cd3b176 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:29.882993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.885256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.891728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6002e21c695746aba1d1ea9cdd905996', 'request_id': 'req-4a84236a-5b7d-49fa-816b-22034f6e89c1'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.899550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6002e21c695746aba1d1ea9cdd905996', 'request_id': 'req-4a84236a-5b7d-49fa-816b-22034f6e89c1'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.907995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6002e21c695746aba1d1ea9cdd905996', 'request_id': 'req-4a84236a-5b7d-49fa-816b-22034f6e89c1'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.921715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] The token cache is being invalidate because project 6002e21c695746aba1d1ea9cdd905996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:29.922416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.922919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:29.924813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 995/1996] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:29 2022] DELETE /identity/v3/projects/6002e21c695746aba1d1ea9cdd905996 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:29.925716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:29.927142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:29.967980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462ac0-2ddb-4e74-8949-64458ef5b0bb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:29.972282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:30.017680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84236a-5b7d-49fa-816b-22034f6e89c1 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.025394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111d090-3ed1-41e7-8f2e-1d81bc0d48b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.026692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111d090-3ed1-41e7-8f2e-1d81bc0d48b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.033941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111d090-3ed1-41e7-8f2e-1d81bc0d48b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.035171 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111d090-3ed1-41e7-8f2e-1d81bc0d48b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.035928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111d090-3ed1-41e7-8f2e-1d81bc0d48b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.041873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111d090-3ed1-41e7-8f2e-1d81bc0d48b5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.085320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 996/1997] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:29 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:30.086954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ff709-e99f-43c1-af43-bd6cbebce385 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.087385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ff709-e99f-43c1-af43-bd6cbebce385 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.087541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ff709-e99f-43c1-af43-bd6cbebce385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.093957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.094640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.094955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.095822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.096567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.099331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.112757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8d5ff709-e99f-43c1-af43-bd6cbebce385 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:30.114185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8d5ff709-e99f-43c1-af43-bd6cbebce385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:30.132206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 997/1998] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:30.132206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7805cd9-4cbb-4a59-a829-393528e8a0f3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.132206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7805cd9-4cbb-4a59-a829-393528e8a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.132206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7805cd9-4cbb-4a59-a829-393528e8a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.152870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1002/1999] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:29 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:30.152870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.160083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b7805cd9-4cbb-4a59-a829-393528e8a0f3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:30.161961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b7805cd9-4cbb-4a59-a829-393528e8a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:30.241108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 998/2000] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:30.243803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.244226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.244741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.281582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:30.283433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:30.291398 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60c26-2dad-4170-a7bd-31abe8df28eb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.296215 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1280199-60b0-4ca1-b917-9800fbe3d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.297119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1280199-60b0-4ca1-b917-9800fbe3d117 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.297415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1280199-60b0-4ca1-b917-9800fbe3d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.297741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1280199-60b0-4ca1-b917-9800fbe3d117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.298478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1280199-60b0-4ca1-b917-9800fbe3d117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.299893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 999/2001] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:30.300530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1280199-60b0-4ca1-b917-9800fbe3d117 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.301006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.303989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:30.316494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1003/2002] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:30.318147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73a89-e8ed-4dbe-9e21-1135ab011ea7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.318423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73a89-e8ed-4dbe-9e21-1135ab011ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.318707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73a89-e8ed-4dbe-9e21-1135ab011ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.337339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38be9c3-6bb8-4fcf-addb-9d2c1a0752c8 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.352584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.353668 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.360074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.360425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.361159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.362527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e0b73a89-e8ed-4dbe-9e21-1135ab011ea7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:30.363153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.364140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e0b73a89-e8ed-4dbe-9e21-1135ab011ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:30.385787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1004/2003] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:30.387020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73a89-e8ed-4dbe-9e21-1135ab011ea7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.395354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1000/2004] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:30.396461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.408516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733ae50-6db1-41b7-a9fb-c9a342469189 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.416682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.417763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.418054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.418338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] PATH_INFO: `/v3/projects/53a310f73a144386b3529792e85adc83/users/395573829a114dd685aa3419bc90f725/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.425578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73a89-e8ed-4dbe-9e21-1135ab011ea7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.434149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=87,keystone:DELETE=6,keystone:INSERT=7 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:30.446386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a310f73a144386b3529792e85adc83, user_id=395573829a114dd685aa3419bc90f725, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.446793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.447455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.447740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.448016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.448741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:30.449049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.450106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.457326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.482524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1001/2005] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:30 2022] PUT /identity/v3/projects/53a310f73a144386b3529792e85adc83/users/395573829a114dd685aa3419bc90f725/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:30.483849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.490671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1005/2006] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:30.490671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.514188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7df34b-622e-48d3-b68f-e095c0d9931c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.577926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370b31a-a023-4d50-abad-bf1992683b70 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.584895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.586517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.586996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.588240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.589162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:30.590427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.591332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.600211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.601704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.602067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.603525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.604579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.606329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.606479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1002/2007] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:30.607385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.620548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d3dc-d509-4db5-9b7f-d86f2f7ebd4b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.626150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1006/2008] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:30.626150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.637407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:30.642436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852c0c-5d19-461b-b583-30a94c9ef9a0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.649976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.650149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.650807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.651201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.651505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.651768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.652268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.652475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.652937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.654310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.654416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.657317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.676459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1003/2009] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:30.682414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.694699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1007/2010] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:30.697632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d43bf2-9433-4500-89ca-ff2d31b41946 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.699015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.776483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.777441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.778024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.778681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.779749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.782391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.792965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39019b4-a617-463b-b71f-9837999ea1dd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.799902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.801168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.801905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.802191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] PATH_INFO: `/v3/projects/ece70165b20d4a73a54a42191208de05/users/a5ec8b92841e4326b39a456b9496be79/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.822218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece70165b20d4a73a54a42191208de05, user_id=a5ec8b92841e4326b39a456b9496be79, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.826289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.842187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1004/2011] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:30.844193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.850668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1008/2012] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:30 2022] PUT /identity/v3/projects/ece70165b20d4a73a54a42191208de05/users/a5ec8b92841e4326b39a456b9496be79/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:30.852741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:30.918628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:30.926340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bed01-d708-4dd0-b15f-03cc16476e87 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.942727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2878f-4189-45e2-ba2f-b0f1c76c1793 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:30.951758 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:30.952112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:30.953130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:30.953422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:30.955185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:30.961762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:30.995839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1009/2013] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:30.995839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.014325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50d7eb-73e5-4df2-a0de-82cf6bb04b8c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.018526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.019871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.020188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.020494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.020743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.021099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.021199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] PATH_INFO: `/v3/projects/53a310f73a144386b3529792e85adc83/users/395573829a114dd685aa3419bc90f725/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.021513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.022676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.024038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a310f73a144386b3529792e85adc83, user_id=395573829a114dd685aa3419bc90f725, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.024944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.027643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.061446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1010/2014] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:30 2022] POST /identity/v3/users => generated 285 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:31.061446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.081315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1005/2015] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:30 2022] PUT /identity/v3/projects/53a310f73a144386b3529792e85adc83/users/395573829a114dd685aa3419bc90f725/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:31.081315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.081629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d5002-315b-40d7-86cd-79ec04254a37 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.150370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:31.186810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.187595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.187887 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.188169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.188917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.191645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.199218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d25d4b-ca3b-401e-bed3-07896455d58a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.204127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c724c34-3fc4-4ebd-818d-af03ac059642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.208400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1011/2016] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:31.208581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c724c34-3fc4-4ebd-818d-af03ac059642 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.208581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c724c34-3fc4-4ebd-818d-af03ac059642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.208581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c724c34-3fc4-4ebd-818d-af03ac059642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.208812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.208883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c724c34-3fc4-4ebd-818d-af03ac059642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.208883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c724c34-3fc4-4ebd-818d-af03ac059642 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.219279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e98df8-d883-41b8-9b85-bdcb795b751c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.220193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1006/2017] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:31.221552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10799-bc09-4ae2-9a5d-3a0faf0f213d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.221844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10799-bc09-4ae2-9a5d-3a0faf0f213d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.222124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10799-bc09-4ae2-9a5d-3a0faf0f213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.227363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.228173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.228528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.228879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.229787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.231496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.243361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1012/2018] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:31.244437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.256066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba488709-3481-4110-b38d-5ba4d6c6cfdb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.258431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b4e10799-bc09-4ae2-9a5d-3a0faf0f213d None None] MFA Rules not processed for user `395573829a114dd685aa3419bc90f725`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:31.259930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b4e10799-bc09-4ae2-9a5d-3a0faf0f213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:31.261691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.262673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.263028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.263370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] PATH_INFO: `/v3/projects/ece70165b20d4a73a54a42191208de05/users/a5ec8b92841e4326b39a456b9496be79/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.265443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece70165b20d4a73a54a42191208de05, user_id=a5ec8b92841e4326b39a456b9496be79, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.268244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.281662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1013/2019] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:31 2022] PUT /identity/v3/projects/ece70165b20d4a73a54a42191208de05/users/a5ec8b92841e4326b39a456b9496be79/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:31.284141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.355255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1007/2020] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:31.356579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10799-bc09-4ae2-9a5d-3a0faf0f213d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.368930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10799-bc09-4ae2-9a5d-3a0faf0f213d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.383356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:31.385287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6032d-dea8-4d0c-97d7-29fdad6c329e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.391229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f29150-c520-48d6-9452-c8ddbd5c0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.391938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f29150-c520-48d6-9452-c8ddbd5c0b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.392258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f29150-c520-48d6-9452-c8ddbd5c0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.392898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f29150-c520-48d6-9452-c8ddbd5c0b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.393683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f29150-c520-48d6-9452-c8ddbd5c0b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.395303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f29150-c520-48d6-9452-c8ddbd5c0b47 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.407551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1014/2021] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:31.409947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883f869-ce43-443f-b64f-ec8b89d63baf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.410465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883f869-ce43-443f-b64f-ec8b89d63baf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.410939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883f869-ce43-443f-b64f-ec8b89d63baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.442560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.443237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.443518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.443789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.444511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.446724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.447114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d883f869-ce43-443f-b64f-ec8b89d63baf None None] MFA Rules not processed for user `a5ec8b92841e4326b39a456b9496be79`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:31.448527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d883f869-ce43-443f-b64f-ec8b89d63baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:31.466789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1008/2022] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:31.468996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.470997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:31.543770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1015/2023] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:31.544478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883f869-ce43-443f-b64f-ec8b89d63baf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.557450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883f869-ce43-443f-b64f-ec8b89d63baf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.563109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.563991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.564360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.564640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] PATH_INFO: `/v3/projects/a490ae6f5c904e1090fcf2e285040906/users/307ae72eadb8423cb2693c0d99f69b57/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.575801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63db95a-3b4b-4d51-b009-a408f2da634d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.580486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.582606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.583046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a490ae6f5c904e1090fcf2e285040906, user_id=307ae72eadb8423cb2693c0d99f69b57, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.583506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.584087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.586431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.612709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1016/2024] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:31 2022] PUT /identity/v3/projects/a490ae6f5c904e1090fcf2e285040906/users/307ae72eadb8423cb2693c0d99f69b57/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:31.613169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.632759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:31.673581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.675264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.688719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1009/2025] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:31.689620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:31.691666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:31.727495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb7be-b19d-4a6f-9ff1-b221c80abef5 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.771429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c34c-c458-4589-b990-0c684afe642c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:31.782944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff570-e0d7-4c9c-bf77-c96e67b050a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.785996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff570-e0d7-4c9c-bf77-c96e67b050a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.789990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff570-e0d7-4c9c-bf77-c96e67b050a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.790311 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff570-e0d7-4c9c-bf77-c96e67b050a9 admin admin] PATH_INFO: `/v3/projects/1718872dcac34f6285aaaf90b2b26927/users/d8640c18da6e4b1dadf6bff7bf423e71/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.825902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ff570-e0d7-4c9c-bf77-c96e67b050a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1718872dcac34f6285aaaf90b2b26927, user_id=d8640c18da6e4b1dadf6bff7bf423e71, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:31.828901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ff570-e0d7-4c9c-bf77-c96e67b050a9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:31.835305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45e9f6-d913-400f-8d81-e0c0ebc31ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:31.836945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45e9f6-d913-400f-8d81-e0c0ebc31ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.837376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45e9f6-d913-400f-8d81-e0c0ebc31ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.837930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45e9f6-d913-400f-8d81-e0c0ebc31ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.841383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ef45e9f6-d913-400f-8d81-e0c0ebc31ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:31.854579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1017/2026] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:31 2022] PUT /identity/v3/projects/1718872dcac34f6285aaaf90b2b26927/users/d8640c18da6e4b1dadf6bff7bf423e71/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:31.860968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7b89-8e64-4359-a764-0520c599ca51 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:31.861259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7b89-8e64-4359-a764-0520c599ca51 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:31.861825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7b89-8e64-4359-a764-0520c599ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:31.906184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:31.930948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-49bd7b89-8e64-4359-a764-0520c599ca51 None None] MFA Rules not processed for user `307ae72eadb8423cb2693c0d99f69b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:31.932576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-49bd7b89-8e64-4359-a764-0520c599ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:32.015032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45e9f6-d913-400f-8d81-e0c0ebc31ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.017261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45e9f6-d913-400f-8d81-e0c0ebc31ee8 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:32.048016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1010/2027] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:32.049356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46a9b0-4e1d-450f-8158-cce4e52d6d5b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.049681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46a9b0-4e1d-450f-8158-cce4e52d6d5b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.049959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46a9b0-4e1d-450f-8158-cce4e52d6d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.062159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1018/2028] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:32.063488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b8d98-be51-46d6-b40c-e9bcb10df26c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.063778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b8d98-be51-46d6-b40c-e9bcb10df26c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.064292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b8d98-be51-46d6-b40c-e9bcb10df26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.100400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ac46a9b0-4e1d-450f-8158-cce4e52d6d5b None None] MFA Rules not processed for user `d8640c18da6e4b1dadf6bff7bf423e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:32.102269 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ac46a9b0-4e1d-450f-8158-cce4e52d6d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:32.119914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-de3b8d98-be51-46d6-b40c-e9bcb10df26c None None] MFA Rules not processed for user `15b5f15066094c77995edbeaba76865c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:32.120988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-de3b8d98-be51-46d6-b40c-e9bcb10df26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:32.229782 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1011/2029] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:32.240876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1019/2030] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:32.240876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b8d98-be51-46d6-b40c-e9bcb10df26c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:32.248069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46a9b0-4e1d-450f-8158-cce4e52d6d5b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:32.261829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:32.366881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b8d98-be51-46d6-b40c-e9bcb10df26c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:32.367705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46a9b0-4e1d-450f-8158-cce4e52d6d5b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:32.373846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:32.374488 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:32.374653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.374933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.376166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.376166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.377101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.377768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.377921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:32.378983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.407695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.411281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:32.447352 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1020/2031] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:32 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:32.451545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:32.452571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1012/2032] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:32.597646 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2ea36-3815-4dd4-a749-9412ef1ee009 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:32.603349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:32.605281 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.605620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.605911 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.606608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.609249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:32.638149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1021/2033] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:32 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:32.641380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:32.655046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ecef-29e7-45ba-bbc6-734623c1e6c8 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:32.660552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:32.661420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.661750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.662095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.665994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.667759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:32.671889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:32.687362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1013/2034] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:32.691933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:32.703950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c225b-5e0c-4032-8bec-d19902031faa admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:32.711231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:32.712117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.712394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.712719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] PATH_INFO: `/v3/projects/45473fec09914a929540687c684137ef/users/ca905af4505b4b73a7519fae4351e917/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.761423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45473fec09914a929540687c684137ef, user_id=ca905af4505b4b73a7519fae4351e917, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.764086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:32.771205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f141-8004-470c-bf40-7472d10483a3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:32.792145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1014/2035] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:32 2022] PUT /identity/v3/projects/45473fec09914a929540687c684137ef/users/ca905af4505b4b73a7519fae4351e917/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:32.797725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:32.800085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:32.801144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.804634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.807384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.811263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:32.854113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:32.913387 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:32.973750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.976357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748962e9-0823-4de6-88af-355fce7f9730 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:32.986742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:32.990154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f0e0e-83b5-41d2-a805-6c16cbfd0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:32.991132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f0e0e-83b5-41d2-a805-6c16cbfd0b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:32.991516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f0e0e-83b5-41d2-a805-6c16cbfd0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:32.992419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f0e0e-83b5-41d2-a805-6c16cbfd0b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:32.993359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f0e0e-83b5-41d2-a805-6c16cbfd0b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:32.998961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f0e0e-83b5-41d2-a805-6c16cbfd0b37 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:33.013794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1022/2036] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:33.015087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1015/2037] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:33.018925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:33.044968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4228c2-2a98-4ff8-9a50-0029560b145c service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:33.051439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:33.052571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:33.052857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:33.053324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] PATH_INFO: `/v3/projects/45473fec09914a929540687c684137ef/users/ca905af4505b4b73a7519fae4351e917/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:33.056440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45473fec09914a929540687c684137ef, user_id=ca905af4505b4b73a7519fae4351e917, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:33.059500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:33.078342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1023/2038] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:33 2022] PUT /identity/v3/projects/45473fec09914a929540687c684137ef/users/ca905af4505b4b73a7519fae4351e917/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:33.090137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277b74-f1e1-4773-96b6-8c7cf36581f1 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:33.090731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277b74-f1e1-4773-96b6-8c7cf36581f1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:33.090928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277b74-f1e1-4773-96b6-8c7cf36581f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:33.127735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e5277b74-f1e1-4773-96b6-8c7cf36581f1 None None] MFA Rules not processed for user `ca905af4505b4b73a7519fae4351e917`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:33.129706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e5277b74-f1e1-4773-96b6-8c7cf36581f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:33.239684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1016/2039] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:33.272440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:33.335456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458a727-42c0-4104-92e5-891e7016d135 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:33.339108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:33.339840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:33.340067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:33.340369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:33.350773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:33.352956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:33.364921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1024/2040] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:33.473525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5277b74-f1e1-4773-96b6-8c7cf36581f1 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:33.486227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5277b74-f1e1-4773-96b6-8c7cf36581f1 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:33.490493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:33.491287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:33.492086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:33.492368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:33.569673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:33.571753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:33.581316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1017/2041] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:34.221819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:34.232214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e447ad-c7ef-4c84-82ef-e77cd9fa6f1f service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:34.235901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:34.236611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:34.236895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:34.237171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:34.238999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:34.359364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:34.361907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:34.373358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1025/2042] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:34.922142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:34.931547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d691c3-20aa-4baa-83e8-4c9f1c766fa2 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:34.940880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:34.942029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:34.942470 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:34.943344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:34.995999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:35.027177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:35.028975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:35.038711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1018/2043] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:35.211876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:35.220355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c9d63-fb77-467c-b10f-c25ab7e6e44d service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:35.225288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc973e7d-07ab-4afb-a8bf-d60b2bc3e2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:35.226128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973e7d-07ab-4afb-a8bf-d60b2bc3e2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:35.226529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973e7d-07ab-4afb-a8bf-d60b2bc3e2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:35.226871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973e7d-07ab-4afb-a8bf-d60b2bc3e2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:35.291152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:35.293142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:35.294074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc973e7d-07ab-4afb-a8bf-d60b2bc3e2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:35.295906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc973e7d-07ab-4afb-a8bf-d60b2bc3e2d5 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:35.315746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1026/2044] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:35.392589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7291-5ce1-40e0-8b58-7f5d3b2d32b3 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:35.402934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:35.403830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:35.404558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:35.406469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] PATH_INFO: `/v3/users/0e8cd4f401bc4190beb165166f9d59b9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:35.407941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8cd4f401bc4190beb165166f9d59b9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:35.414389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:35.480609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8cd4f401bc4190beb165166f9d59b9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:35.481277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8cd4f401bc4190beb165166f9d59b9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:35.495196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8cd4f401bc4190beb165166f9d59b9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:35.495992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8cd4f401bc4190beb165166f9d59b9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:35.505078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8cd4f401bc4190beb165166f9d59b9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:35.518291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1019/2045] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:35 2022] DELETE /identity/v3/users/0e8cd4f401bc4190beb165166f9d59b9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:35.523070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:35.523366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:35.523675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:35.540727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:35.541969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:35.604789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1027/2046] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:35.615106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:35.617188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:35.684010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:35.691300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009c853-93a1-4641-83e9-46d596261ef3 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:35.700909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:35.702148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:35.702804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:35.703949 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:35.724156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:35.725875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:35.738083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1020/2047] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:36.018051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:36.019458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:36.032321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21df73-0074-4359-a712-8081d604e1a1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:36.037019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:36.037948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:36.038237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:36.038517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] PATH_INFO: `/v3/projects/540c3c8b72244c8a8f99872262b4d80b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:36.039707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540c3c8b72244c8a8f99872262b4d80b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:36.041685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:36.090622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540c3c8b72244c8a8f99872262b4d80b', 'request_id': 'req-cac43683-638a-4d91-ad39-0a3457b03f66'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.097619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540c3c8b72244c8a8f99872262b4d80b', 'request_id': 'req-cac43683-638a-4d91-ad39-0a3457b03f66'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.103839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540c3c8b72244c8a8f99872262b4d80b', 'request_id': 'req-cac43683-638a-4d91-ad39-0a3457b03f66'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.113903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] The token cache is being invalidate because project 540c3c8b72244c8a8f99872262b4d80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:36.114186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.114798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.116290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1028/2048] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:36 2022] DELETE /identity/v3/projects/540c3c8b72244c8a8f99872262b4d80b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:36.120248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:36.129921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dcba0-7afc-4826-abb7-f3bb7835875a service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:36.186522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:36.187390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:36.187676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:36.187953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] PATH_INFO: `/v3/users/395573829a114dd685aa3419bc90f725` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:36.189138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395573829a114dd685aa3419bc90f725)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:36.191093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:36.239042 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395573829a114dd685aa3419bc90f725'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.239710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395573829a114dd685aa3419bc90f725'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.251414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395573829a114dd685aa3419bc90f725'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.252039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395573829a114dd685aa3419bc90f725'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.260010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2ca51f09-5f63-4801-a9e8-f36111485979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395573829a114dd685aa3419bc90f725'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.272371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1021/2049] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:36 2022] DELETE /identity/v3/users/395573829a114dd685aa3419bc90f725 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:36.538773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:36.540303 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:36.553523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43683-638a-4d91-ad39-0a3457b03f66 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:36.613773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:36.614677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:36.614946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:36.615225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] PATH_INFO: `/v3/projects/53a310f73a144386b3529792e85adc83` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:36.617232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a310f73a144386b3529792e85adc83)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:36.619185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:36.642544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:36.667757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a310f73a144386b3529792e85adc83', 'request_id': 'req-79cafa2e-0f61-4827-b347-293d22511437'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.675176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a310f73a144386b3529792e85adc83', 'request_id': 'req-79cafa2e-0f61-4827-b347-293d22511437'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.682580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a310f73a144386b3529792e85adc83', 'request_id': 'req-79cafa2e-0f61-4827-b347-293d22511437'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.693249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] The token cache is being invalidate because project 53a310f73a144386b3529792e85adc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:36.693583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.694350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-79cafa2e-0f61-4827-b347-293d22511437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:36.696432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1029/2050] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:36 2022] DELETE /identity/v3/projects/53a310f73a144386b3529792e85adc83 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:36.701352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426d03-d42c-4a3d-a70f-1e0531a930e5 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:36.701676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426d03-d42c-4a3d-a70f-1e0531a930e5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:36.701961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426d03-d42c-4a3d-a70f-1e0531a930e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:36.721846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-21426d03-d42c-4a3d-a70f-1e0531a930e5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:36.723051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-21426d03-d42c-4a3d-a70f-1e0531a930e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:36.783235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1022/2051] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:36.791534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ebd41-4a63-425f-8a13-c8b6db242177 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:36.791824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ebd41-4a63-425f-8a13-c8b6db242177 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:36.792102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ebd41-4a63-425f-8a13-c8b6db242177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:36.811406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-726ebd41-4a63-425f-8a13-c8b6db242177 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:36.812603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-726ebd41-4a63-425f-8a13-c8b6db242177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:36.820979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1030/2052] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:36.825098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426d03-d42c-4a3d-a70f-1e0531a930e5 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:36.835300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426d03-d42c-4a3d-a70f-1e0531a930e5 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:36.839811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:36.840457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:36.840736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:36.841009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:36.841769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:36.842072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:36.843639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:36.855051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:36.863148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1023/2053] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:36.866515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ebd41-4a63-425f-8a13-c8b6db242177 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:36.877275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ebd41-4a63-425f-8a13-c8b6db242177 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:36.882292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:36.882926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:36.883237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:36.883471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:36.884185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:36.886266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:36.915205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1031/2054] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:36 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:36.919099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:36.935521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8eae-06a8-4519-bafb-6f7e5aca965f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.022186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.022900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.023184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.023458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.024193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.026388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.047730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1024/2055] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:36 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:37.051805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.062677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b448d0-f045-463c-b969-bfa5df49efc0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.068075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.068736 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.069353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.069731 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.070724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.072529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.085496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1032/2056] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:37.088399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.099221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d60a4-049f-4c96-8d4d-47ede27f73a0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.104438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83a473-b5c6-48c8-a9f4-9e4d3539270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.105103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83a473-b5c6-48c8-a9f4-9e4d3539270d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.105613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83a473-b5c6-48c8-a9f4-9e4d3539270d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.105894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83a473-b5c6-48c8-a9f4-9e4d3539270d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.106624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83a473-b5c6-48c8-a9f4-9e4d3539270d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.108268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83a473-b5c6-48c8-a9f4-9e4d3539270d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.119069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1025/2057] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:37.123194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.132928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a5f41-65ab-4fc3-b9f1-822670835246 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.137918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.138900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.139184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.139462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] PATH_INFO: `/v3/projects/a92156d204ba4551815f494808f31dd9/users/6fbf5f625b9a40bca796984436c98b1d/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.154828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92156d204ba4551815f494808f31dd9, user_id=6fbf5f625b9a40bca796984436c98b1d, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.158121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.172729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1033/2058] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:37 2022] PUT /identity/v3/projects/a92156d204ba4551815f494808f31dd9/users/6fbf5f625b9a40bca796984436c98b1d/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:37.183788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.184323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.184466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.212798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] MFA Rules not processed for user `6fbf5f625b9a40bca796984436c98b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:37.214178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:37.278909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1026/2059] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:37.283922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.303024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.304916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:37.347545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd2ab-deb5-463e-b8f5-8908f3a934b6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.354498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.355162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.355473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.355751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.356468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.358506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.378074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6c827-6fce-47d4-ad25-5d126f40c5ee None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.382742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.383628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.383909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.384185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] PATH_INFO: `/v3/users/d8640c18da6e4b1dadf6bff7bf423e71` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.385340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1034/2060] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:37 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:37.385552 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8640c18da6e4b1dadf6bff7bf423e71)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.387358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.389281 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.393085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:37.426587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:37.440962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8640c18da6e4b1dadf6bff7bf423e71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:37.441748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8640c18da6e4b1dadf6bff7bf423e71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:37.457528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8640c18da6e4b1dadf6bff7bf423e71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:37.459027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8640c18da6e4b1dadf6bff7bf423e71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:37.460865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de8fe-6463-4745-b272-4c98674aa40d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.468143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.468822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.469105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.469374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.470098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.470798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a7eff3ee-2d46-491d-ab47-589d18dac38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8640c18da6e4b1dadf6bff7bf423e71'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:37.472031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.485930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1027/2061] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:37 2022] DELETE /identity/v3/users/d8640c18da6e4b1dadf6bff7bf423e71 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:37.490445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.490806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.491165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.497280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1035/2062] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:37 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:37.500982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.502667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:37.512057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:37.513249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:37.515168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60a73-056c-4949-9fb6-8ab77106c48d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.575938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.576618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.576905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.577183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.577954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.579550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.580744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1028/2063] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:37.593561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1036/2064] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:37.593713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.593713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:37.594525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.604301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091aa9-0dc2-4339-958e-f33d5970b44e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.609036 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.609992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.610275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.610553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] PATH_INFO: `/v3/projects/652575b47fd14ddf9b0d30c258bd512d/users/b6c5c0a581ea49969b89c07495387616/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.625910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=652575b47fd14ddf9b0d30c258bd512d, user_id=b6c5c0a581ea49969b89c07495387616, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.628563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.642077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1037/2065] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:37 2022] PUT /identity/v3/projects/652575b47fd14ddf9b0d30c258bd512d/users/b6c5c0a581ea49969b89c07495387616/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:37.645835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.654473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a00065-9678-4ed4-82e5-623b2a0e4930 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.693750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:37.708753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159de0-83d4-43d4-808a-8f93267d06ea admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.709089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ce952-d29c-4fe9-95d2-2929a39197b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.709624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce952-d29c-4fe9-95d2-2929a39197b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.711073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce952-d29c-4fe9-95d2-2929a39197b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.711729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce952-d29c-4fe9-95d2-2929a39197b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.715178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.716003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.716290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.716572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.717310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.718999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.723763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ce952-d29c-4fe9-95d2-2929a39197b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.725212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ce952-d29c-4fe9-95d2-2929a39197b7 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.730047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1038/2066] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:37.734260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.744144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb4e90-90e8-4d24-b339-06b3ddcddf0a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.745536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1029/2067] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:19:37.749038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.749949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.750234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.750514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] PATH_INFO: `/v3/projects/652575b47fd14ddf9b0d30c258bd512d/users/b6c5c0a581ea49969b89c07495387616/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.752511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652575b47fd14ddf9b0d30c258bd512d, user_id=b6c5c0a581ea49969b89c07495387616, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.755208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:37.766991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1039/2068] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:37 2022] PUT /identity/v3/projects/652575b47fd14ddf9b0d30c258bd512d/users/b6c5c0a581ea49969b89c07495387616/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:37.777641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8181d0a-e254-484b-8795-ee4024ba6373 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.778014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8181d0a-e254-484b-8795-ee4024ba6373 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.778423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8181d0a-e254-484b-8795-ee4024ba6373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.806469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c8181d0a-e254-484b-8795-ee4024ba6373 None None] MFA Rules not processed for user `b6c5c0a581ea49969b89c07495387616`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:37.807691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c8181d0a-e254-484b-8795-ee4024ba6373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:37.883541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1030/2069] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:37.895570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:37.897997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:37.929963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:37.975402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a915f-ce92-48f4-9a53-c5c24b302378 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:37.979197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:37.979846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:37.980128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:37.980403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:37.989812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:37.991241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:38.002378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1040/2070] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:38.077710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8181d0a-e254-484b-8795-ee4024ba6373 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:38.120032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:38.121567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.161486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8181d0a-e254-484b-8795-ee4024ba6373 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:38.170094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:38.171559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:38.171559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:38.171850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] PATH_INFO: `/v3/users/6fbf5f625b9a40bca796984436c98b1d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:38.173198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbf5f625b9a40bca796984436c98b1d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:38.175336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:38.218733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4865800-d6c2-4b8e-a548-f4cfb57ec640 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:38.224004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:38.224927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:38.225234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:38.225563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] PATH_INFO: `/v3/projects/1718872dcac34f6285aaaf90b2b26927` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:38.227388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1718872dcac34f6285aaaf90b2b26927)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:38.229299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:38.232918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbf5f625b9a40bca796984436c98b1d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.233679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbf5f625b9a40bca796984436c98b1d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.246466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbf5f625b9a40bca796984436c98b1d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.247159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbf5f625b9a40bca796984436c98b1d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.254865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b0ba3c7e-0b1e-4277-89b9-d311cd4eef5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbf5f625b9a40bca796984436c98b1d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.256437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:38.271690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1031/2071] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:38 2022] DELETE /identity/v3/users/6fbf5f625b9a40bca796984436c98b1d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:38.276523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:38.276810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:38.277086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:38.279741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1718872dcac34f6285aaaf90b2b26927', 'request_id': 'req-167ea1ce-cd11-48b1-ae23-61bc05d1d916'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.287333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1718872dcac34f6285aaaf90b2b26927', 'request_id': 'req-167ea1ce-cd11-48b1-ae23-61bc05d1d916'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.293718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1718872dcac34f6285aaaf90b2b26927', 'request_id': 'req-167ea1ce-cd11-48b1-ae23-61bc05d1d916'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.294476 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:38.295729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.304864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] The token cache is being invalidate because project 1718872dcac34f6285aaaf90b2b26927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:38.305158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.305824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.307341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1041/2072] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:38 2022] DELETE /identity/v3/projects/1718872dcac34f6285aaaf90b2b26927 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:38.311032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:38.312330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.363199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:38.363551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1032/2073] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:38.373641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:38.375071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.379545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ea1ce-cd11-48b1-ae23-61bc05d1d916 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:38.385036 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:38.386061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:38.386344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:38.386622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] PATH_INFO: `/v3/users/ca905af4505b4b73a7519fae4351e917` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:38.387933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca905af4505b4b73a7519fae4351e917)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:38.389946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:38.435057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0006e1-5423-4353-b2bc-e951151911df None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:38.437900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca905af4505b4b73a7519fae4351e917'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.438654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca905af4505b4b73a7519fae4351e917'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.438858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:38.439607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:38.439891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:38.440167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:38.441972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.447697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca905af4505b4b73a7519fae4351e917'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.455053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:38.456469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:38.461224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca905af4505b4b73a7519fae4351e917'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.461981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca905af4505b4b73a7519fae4351e917'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.467175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1033/2074] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:19:38.477665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1042/2075] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:38 2022] DELETE /identity/v3/users/ca905af4505b4b73a7519fae4351e917 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:38.774933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:38.776913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.796020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60605ca-c790-452e-9fb0-4c6325465c04 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:38.863526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:38.864502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:38.864786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:38.865061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] PATH_INFO: `/v3/projects/a92156d204ba4551815f494808f31dd9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:38.866324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92156d204ba4551815f494808f31dd9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:38.868730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:38.907812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:38.918703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92156d204ba4551815f494808f31dd9', 'request_id': 'req-96449051-03dc-4227-a5df-63be50218d22'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.925943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92156d204ba4551815f494808f31dd9', 'request_id': 'req-96449051-03dc-4227-a5df-63be50218d22'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.936430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92156d204ba4551815f494808f31dd9', 'request_id': 'req-96449051-03dc-4227-a5df-63be50218d22'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.958806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:38.960403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.961848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] The token cache is being invalidate because project a92156d204ba4551815f494808f31dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:38.962634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.963651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:38.966424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1034/2076] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:38 2022] DELETE /identity/v3/projects/a92156d204ba4551815f494808f31dd9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:38.969920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:38.972418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:38.976817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bee9-e55c-4d99-8acf-41c57dd374d5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.050645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.053034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.053824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.053824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] PATH_INFO: `/v3/projects/45473fec09914a929540687c684137ef` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.055675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45473fec09914a929540687c684137ef)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.057658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.095078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449051-03dc-4227-a5df-63be50218d22 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.102266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.103224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.103506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.103777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] PATH_INFO: `/v3/users/b6c5c0a581ea49969b89c07495387616` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.105146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c5c0a581ea49969b89c07495387616)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.107182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.118849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45473fec09914a929540687c684137ef', 'request_id': 'req-4df7c2d8-806a-41bc-9c0f-d86816e3992c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.126846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45473fec09914a929540687c684137ef', 'request_id': 'req-4df7c2d8-806a-41bc-9c0f-d86816e3992c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.133929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45473fec09914a929540687c684137ef', 'request_id': 'req-4df7c2d8-806a-41bc-9c0f-d86816e3992c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.141658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:39.147756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] The token cache is being invalidate because project 45473fec09914a929540687c684137ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:39.148770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.149692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4df7c2d8-806a-41bc-9c0f-d86816e3992c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.151312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1043/2077] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:38 2022] DELETE /identity/v3/projects/45473fec09914a929540687c684137ef => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:39.157019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034faee-9938-4fea-b95f-7c1e73063d2a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.158098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034faee-9938-4fea-b95f-7c1e73063d2a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.160783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034faee-9938-4fea-b95f-7c1e73063d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.163780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c5c0a581ea49969b89c07495387616'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.164897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c5c0a581ea49969b89c07495387616'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.179956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c5c0a581ea49969b89c07495387616'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.180649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c5c0a581ea49969b89c07495387616'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.182362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8034faee-9938-4fea-b95f-7c1e73063d2a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:39.183623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8034faee-9938-4fea-b95f-7c1e73063d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:39.188549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-fc3643f4-b6ef-4860-896a-4cd2feb522e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c5c0a581ea49969b89c07495387616'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.201775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1035/2078] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:38 2022] DELETE /identity/v3/users/b6c5c0a581ea49969b89c07495387616 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:39.259359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1044/2079] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:39.261319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c57ed-0e13-4b63-88b9-9733d0ac06fd None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.261822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c57ed-0e13-4b63-88b9-9733d0ac06fd None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.261966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c57ed-0e13-4b63-88b9-9733d0ac06fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.283666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-6f7c57ed-0e13-4b63-88b9-9733d0ac06fd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:39.285007 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6f7c57ed-0e13-4b63-88b9-9733d0ac06fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:39.331986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:39.364383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1036/2080] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:39.369336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034faee-9938-4fea-b95f-7c1e73063d2a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.379800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034faee-9938-4fea-b95f-7c1e73063d2a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.384960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.385678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.385967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.386245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.387258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:39.387477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.389041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.404399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1045/2081] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:19:39.408663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c57ed-0e13-4b63-88b9-9733d0ac06fd None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.418712 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c57ed-0e13-4b63-88b9-9733d0ac06fd None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.423501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.424158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.424445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.424718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.425606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.427631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.462859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1037/2082] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:39.464163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.474328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0ffd-2a45-4659-a45b-35e2ff2190a8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.534776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.535610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.535928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.536392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.537157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.542423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.543815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.546571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:39.564510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249860e-e4f2-4404-97e9-6027dc18ec86 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.570637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.571647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.571999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.572416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] PATH_INFO: `/v3/projects/652575b47fd14ddf9b0d30c258bd512d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.574073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652575b47fd14ddf9b0d30c258bd512d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.576661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.583020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1046/2083] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:39.585069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.601560 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f3328-e49a-4520-9291-a359c03ab37c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.608315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.610127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.610501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.611109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.611659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.613609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.628688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1047/2084] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:39.629957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.642688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ff35-e3c6-4a61-a1b7-dd1ae5f68c09 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.645827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652575b47fd14ddf9b0d30c258bd512d', 'request_id': 'req-2da9b1aa-d124-4ff4-a96e-471a1066b149'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.653661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652575b47fd14ddf9b0d30c258bd512d', 'request_id': 'req-2da9b1aa-d124-4ff4-a96e-471a1066b149'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.664935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652575b47fd14ddf9b0d30c258bd512d', 'request_id': 'req-2da9b1aa-d124-4ff4-a96e-471a1066b149'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.677767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] The token cache is being invalidate because project 652575b47fd14ddf9b0d30c258bd512d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:39.678051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.679152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-2da9b1aa-d124-4ff4-a96e-471a1066b149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:39.681165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1038/2085] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:39 2022] DELETE /identity/v3/projects/652575b47fd14ddf9b0d30c258bd512d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:39.686574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627e9c4-f103-4a8d-a83b-de4d67b3fe4e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.686574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627e9c4-f103-4a8d-a83b-de4d67b3fe4e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.686574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627e9c4-f103-4a8d-a83b-de4d67b3fe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.710867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7627e9c4-f103-4a8d-a83b-de4d67b3fe4e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:39.712262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7627e9c4-f103-4a8d-a83b-de4d67b3fe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:39.741550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.742325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.743017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.743017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.743936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.745763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.753837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:39.765205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1048/2086] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:39.766631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.768709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:39.788213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ceafc-1160-4518-96f6-dd19c466af87 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.796358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e7c21-d454-4c1d-bb75-7d310d1ddf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.797636 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e7c21-d454-4c1d-bb75-7d310d1ddf50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.798309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e7c21-d454-4c1d-bb75-7d310d1ddf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.798738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e7c21-d454-4c1d-bb75-7d310d1ddf50 admin admin] PATH_INFO: `/v3/projects/576da0317ff144b0ba2e34358ef1e4b5/users/65935c10aa5e47b1a1445ae57e9ddc6e/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.814208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1039/2087] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:39.822442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e8bd-6f2e-44e3-b942-bc914e9af6cb None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.822738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e8bd-6f2e-44e3-b942-bc914e9af6cb None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.823022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e8bd-6f2e-44e3-b942-bc914e9af6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.827228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e7c21-d454-4c1d-bb75-7d310d1ddf50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576da0317ff144b0ba2e34358ef1e4b5, user_id=65935c10aa5e47b1a1445ae57e9ddc6e, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.829979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e7c21-d454-4c1d-bb75-7d310d1ddf50 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.845001 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1049/2088] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:39 2022] PUT /identity/v3/projects/576da0317ff144b0ba2e34358ef1e4b5/users/65935c10aa5e47b1a1445ae57e9ddc6e/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:39.845226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-96c1e8bd-6f2e-44e3-b942-bc914e9af6cb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:39.846544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-96c1e8bd-6f2e-44e3-b942-bc914e9af6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:39.855484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c577a0-ac90-4521-ad90-026fdc6f4ce2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.855770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c577a0-ac90-4521-ad90-026fdc6f4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.856047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c577a0-ac90-4521-ad90-026fdc6f4ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.895870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-02c577a0-ac90-4521-ad90-026fdc6f4ce2 None None] MFA Rules not processed for user `65935c10aa5e47b1a1445ae57e9ddc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:39.896971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-02c577a0-ac90-4521-ad90-026fdc6f4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:39.907393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:39.934966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1040/2089] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:39.940760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1e8bd-6f2e-44e3-b942-bc914e9af6cb None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.950438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1e8bd-6f2e-44e3-b942-bc914e9af6cb None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.955945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.956607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.956894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.957172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.958205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:39.958564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.960207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:39.974070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1041/2090] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:19:39.975154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1050/2091] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:39.979532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c577a0-ac90-4521-ad90-026fdc6f4ce2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.979666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:39.989578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1585d-835d-4947-9530-9440922214f9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.990766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c577a0-ac90-4521-ad90-026fdc6f4ce2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:39.996617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.996874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:39.997443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.997803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.997906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:39.998087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:39.998726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:39.999045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:39.999155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.000237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.001242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.002395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.033061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1042/2092] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/projects => generated 407 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:40.038169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1051/2093] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:39 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:40.038826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.039668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.107573 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c5af-e4c4-4af1-8678-711b640bd2c3 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.109905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7011eb6-34b8-4866-be41-52831dc35822 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.115498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.116280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.117174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.117304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.117699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.117885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.118170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.118457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.118814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.119285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.121199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.121557 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.148297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1052/2094] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:40 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:40.149363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.152955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1043/2095] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:40 2022] POST /identity/v3/users => generated 304 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:40.154098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.162321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25cd46-4b19-49c7-89ea-0012094f53d5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.169828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.170654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.171118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.171481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.172241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8178835-8e5d-4286-94a4-54d5d34515ba admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.172386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.174082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.179210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.179805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.180095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.180373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.181117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.183472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.187618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1053/2096] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:40.191839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.199280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1044/2097] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:40.202422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9620842-fef8-4844-b643-a35b9fde92a8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.208444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.209118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.210667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.211255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.211632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] PATH_INFO: `/v3/projects/bd5057b3530e4264bb5729d75c970eb1/users/bf63f8545bee4f2d9eaae86948029e33/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.220468 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21091dec-4da2-44bf-a5af-40e0f7ef877b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.227187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.228550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.229097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.229541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.230415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.233122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.238305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5057b3530e4264bb5729d75c970eb1, user_id=bf63f8545bee4f2d9eaae86948029e33, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.242006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.254580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:40.264766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1045/2098] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:40.270827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1054/2099] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:40 2022] PUT /identity/v3/projects/bd5057b3530e4264bb5729d75c970eb1/users/bf63f8545bee4f2d9eaae86948029e33/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:40.271319 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.272157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.282283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27aa66-6bc5-4172-9d5b-585e186eda05 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.346843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb9c26-2507-462a-b9a8-259e1ccc7a6e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.351759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.352327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.352611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.352891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.353828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.355437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.367778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1055/2100] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:40.371278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454564a2-9651-447d-888a-f7c03f996e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.371543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.372177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454564a2-9651-447d-888a-f7c03f996e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.372462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454564a2-9651-447d-888a-f7c03f996e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.372739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454564a2-9651-447d-888a-f7c03f996e80 admin admin] PATH_INFO: `/v3/projects/7498d8ae9eb541f793f16186f15ed44e/users/3ed6848d485d4e57bd5cb2dcca311373/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.381878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856c388-4b99-42bc-8969-42b7e8b2de2d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.387260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05685c2-c587-4e9a-947a-55e1ba565703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.388126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05685c2-c587-4e9a-947a-55e1ba565703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.388406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05685c2-c587-4e9a-947a-55e1ba565703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.388682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05685c2-c587-4e9a-947a-55e1ba565703 admin admin] PATH_INFO: `/v3/projects/bd5057b3530e4264bb5729d75c970eb1/users/bf63f8545bee4f2d9eaae86948029e33/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.388819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454564a2-9651-447d-888a-f7c03f996e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7498d8ae9eb541f793f16186f15ed44e, user_id=3ed6848d485d4e57bd5cb2dcca311373, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.390677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05685c2-c587-4e9a-947a-55e1ba565703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5057b3530e4264bb5729d75c970eb1, user_id=bf63f8545bee4f2d9eaae86948029e33, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.391549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454564a2-9651-447d-888a-f7c03f996e80 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.393296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05685c2-c587-4e9a-947a-55e1ba565703 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.401246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:40.405334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1056/2101] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:40 2022] PUT /identity/v3/projects/bd5057b3530e4264bb5729d75c970eb1/users/bf63f8545bee4f2d9eaae86948029e33/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:40.406187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1046/2102] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:40 2022] PUT /identity/v3/projects/7498d8ae9eb541f793f16186f15ed44e/users/3ed6848d485d4e57bd5cb2dcca311373/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:40.417213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dbb0-15f2-45a2-aa10-9bfd6ad89f25 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.417382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.417537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dbb0-15f2-45a2-aa10-9bfd6ad89f25 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.417740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.417841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dbb0-15f2-45a2-aa10-9bfd6ad89f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.418036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.445362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-da53dbb0-15f2-45a2-aa10-9bfd6ad89f25 None None] MFA Rules not processed for user `bf63f8545bee4f2d9eaae86948029e33`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:40.445748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] MFA Rules not processed for user `3ed6848d485d4e57bd5cb2dcca311373`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:40.446616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-da53dbb0-15f2-45a2-aa10-9bfd6ad89f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:40.447150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:40.520372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1047/2104] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:40.520593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1057/2104] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:40.526423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53dbb0-15f2-45a2-aa10-9bfd6ad89f25 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.532126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.533675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:40.596098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53dbb0-15f2-45a2-aa10-9bfd6ad89f25 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.601490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.602155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.602498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.602705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.603404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.604840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef566e2-fa22-486f-a650-68336bbba1a6 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.605325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.608675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.609323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.609636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.609915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.620467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.622855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.625111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:40.637176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1048/2105] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:19:40.647804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1058/2106] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:40 2022] POST /identity/v3/projects => generated 407 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:40.651614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.665352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448cf9-1256-49e6-b0d7-74bd12feb9eb service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.666568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.725439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.726662 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.726952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.727232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.727926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.730019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.743213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16a05-7d0a-49f5-953d-0cbf5562c8db admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.750266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.751222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.751565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.751902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] PATH_INFO: `/v3/users/65935c10aa5e47b1a1445ae57e9ddc6e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.755716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65935c10aa5e47b1a1445ae57e9ddc6e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.755716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.756793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1049/2107] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:40 2022] POST /identity/v3/users => generated 310 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:40.760250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.773095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda9327-2b3d-4966-a946-a4a6581e78d9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.779841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.782075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.783204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.783724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.785909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.790013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.810466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1050/2108] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:40.821182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.825626 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65935c10aa5e47b1a1445ae57e9ddc6e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:40.826681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65935c10aa5e47b1a1445ae57e9ddc6e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:40.836635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ae456-7e85-41ad-875a-fadaa5fdcb3e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:40.838813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65935c10aa5e47b1a1445ae57e9ddc6e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:40.843302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:40.845019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.845452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.845898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] PATH_INFO: `/v3/projects/a1b57977522e412eb59a901d1e93a001/users/1b1c91f30a64426a821757f7fdfeedde/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.862993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65935c10aa5e47b1a1445ae57e9ddc6e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:40.863979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3daced8a-ec9f-48e7-b6b5-9518296c8f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65935c10aa5e47b1a1445ae57e9ddc6e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:40.864316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:40.877496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b57977522e412eb59a901d1e93a001, user_id=1b1c91f30a64426a821757f7fdfeedde, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:40.881377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:40.893415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1059/2109] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:40 2022] DELETE /identity/v3/users/65935c10aa5e47b1a1445ae57e9ddc6e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:40.898650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:40.899037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:40.899384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:40.907222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1051/2110] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:40 2022] PUT /identity/v3/projects/a1b57977522e412eb59a901d1e93a001/users/1b1c91f30a64426a821757f7fdfeedde/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:40.913077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:40.917789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:40.920167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:40.921896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:41.041380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d35ed-1bf2-469f-b7dd-59de57295e6a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:41.066692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1060/2111] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:41.077508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:41.079543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:41.097973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:41.123881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:41.124936 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.125085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.125432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.126192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:41.127883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:41.139517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1052/2112] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:41.143600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:41.154293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc9447-d395-4560-887e-fdb18ab83e00 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:41.161211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d76b6-f0c7-41aa-8aec-8ebaf9fb5734 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:41.161726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2704a9-1d69-493f-93b0-b8557709c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:41.162921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2704a9-1d69-493f-93b0-b8557709c52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.164017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2704a9-1d69-493f-93b0-b8557709c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.164479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2704a9-1d69-493f-93b0-b8557709c52a admin admin] PATH_INFO: `/v3/projects/a1b57977522e412eb59a901d1e93a001/users/1b1c91f30a64426a821757f7fdfeedde/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.166058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:41.166727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.166945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.167243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.167480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2704a9-1d69-493f-93b0-b8557709c52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b57977522e412eb59a901d1e93a001, user_id=1b1c91f30a64426a821757f7fdfeedde, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:41.171266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2704a9-1d69-493f-93b0-b8557709c52a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:41.177361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:41.178875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:41.183192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1053/2113] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:41 2022] PUT /identity/v3/projects/a1b57977522e412eb59a901d1e93a001/users/1b1c91f30a64426a821757f7fdfeedde/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:41.188654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1061/2114] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:41.193707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.193997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.194275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.222912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] MFA Rules not processed for user `1b1c91f30a64426a821757f7fdfeedde`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:41.224263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:41.299522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1054/2115] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:41 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:41.311490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:41.312953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:41.402269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557398e-fd6d-40c3-8bde-7362b123b260 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:41.455746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:41.456662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.456949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.457231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.470601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:41.472079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:41.486185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1062/2116] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:41 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:41.488375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:41.490343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:41.505886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:41.580588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9263-f870-4a58-802e-9a2584e94c08 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:41.586316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:41.587280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.587578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.587887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] PATH_INFO: `/v3/projects/576da0317ff144b0ba2e34358ef1e4b5` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.589133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576da0317ff144b0ba2e34358ef1e4b5)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:41.591206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:41.644409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576da0317ff144b0ba2e34358ef1e4b5', 'request_id': 'req-d7cb9d61-5217-408d-97db-5f56ad4c3c25'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.648520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:41.650975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576da0317ff144b0ba2e34358ef1e4b5', 'request_id': 'req-d7cb9d61-5217-408d-97db-5f56ad4c3c25'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.658261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278da45-c060-4896-8e43-4b5df36ac0d6 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:41.662273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576da0317ff144b0ba2e34358ef1e4b5', 'request_id': 'req-d7cb9d61-5217-408d-97db-5f56ad4c3c25'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.674251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] The token cache is being invalidate because project 576da0317ff144b0ba2e34358ef1e4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:41.674536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.675173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.676728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1055/2117] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:41 2022] DELETE /identity/v3/projects/576da0317ff144b0ba2e34358ef1e4b5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:41.681186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:41.682847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:41.726950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:41.727698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.728054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.728400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.730392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:41.755148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb9d61-5217-408d-97db-5f56ad4c3c25 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:41.761488 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:41.761632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:41.761889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:41.762162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] PATH_INFO: `/v3/users/bf63f8545bee4f2d9eaae86948029e33` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:41.763387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf63f8545bee4f2d9eaae86948029e33)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:41.764437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:41.765295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:41.797435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:41.798905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:41.807759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:41.809649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1063/2118] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:19:41.821291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf63f8545bee4f2d9eaae86948029e33'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.822068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf63f8545bee4f2d9eaae86948029e33'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.834786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf63f8545bee4f2d9eaae86948029e33'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.835517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf63f8545bee4f2d9eaae86948029e33'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.843684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f0df1c75-04ee-41ae-b2f5-2695b04c7e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf63f8545bee4f2d9eaae86948029e33'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:41.857239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1056/2119] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:41 2022] DELETE /identity/v3/users/bf63f8545bee4f2d9eaae86948029e33 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:42.190349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.205098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d7df3-6a0f-45a5-9895-3f1fda761e31 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.263609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.264468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.264760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.265040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] PATH_INFO: `/v3/projects/bd5057b3530e4264bb5729d75c970eb1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.266240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5057b3530e4264bb5729d75c970eb1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.268153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.313929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5057b3530e4264bb5729d75c970eb1', 'request_id': 'req-b8951b7b-d23f-481d-b5c6-2ae835677561'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:42.320868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5057b3530e4264bb5729d75c970eb1', 'request_id': 'req-b8951b7b-d23f-481d-b5c6-2ae835677561'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:42.327118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5057b3530e4264bb5729d75c970eb1', 'request_id': 'req-b8951b7b-d23f-481d-b5c6-2ae835677561'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:42.337419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] The token cache is being invalidate because project bd5057b3530e4264bb5729d75c970eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:42.337738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:42.339959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8951b7b-d23f-481d-b5c6-2ae835677561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:42.341558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1064/2120] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:42 2022] DELETE /identity/v3/projects/bd5057b3530e4264bb5729d75c970eb1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:42.346455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e727c9-b3e2-4ab5-8f7f-e7837e329764 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.346905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e727c9-b3e2-4ab5-8f7f-e7837e329764 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.346991 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e727c9-b3e2-4ab5-8f7f-e7837e329764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.364722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-72e727c9-b3e2-4ab5-8f7f-e7837e329764 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:42.365969 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-72e727c9-b3e2-4ab5-8f7f-e7837e329764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:42.424584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1057/2121] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:42.432411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2990e-2fd4-41e3-9e0f-525f60308dd8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.432713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2990e-2fd4-41e3-9e0f-525f60308dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.433000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2990e-2fd4-41e3-9e0f-525f60308dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.450732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-60b2990e-2fd4-41e3-9e0f-525f60308dd8 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:42.451934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-60b2990e-2fd4-41e3-9e0f-525f60308dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:42.460561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1065/2122] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:42.464661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e727c9-b3e2-4ab5-8f7f-e7837e329764 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.474100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e727c9-b3e2-4ab5-8f7f-e7837e329764 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.479422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.480055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.480573 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.480856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.481607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:42.481913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.483490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.494719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1058/2123] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:42.498829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2990e-2fd4-41e3-9e0f-525f60308dd8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.508053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2990e-2fd4-41e3-9e0f-525f60308dd8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.512582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.513216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.513522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.513799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.514480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.516352 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.544371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1066/2124] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:42 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:42.548590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.558451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fed5d6-6071-4925-87d3-84c03d429176 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.616037 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.616941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.617281 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.617630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.618332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.620260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.644340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1059/2125] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:42 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:42.645557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.656199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53710229-93dc-4e0c-97f9-275dfb7c807a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.660933 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.661641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.661927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.662207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.662945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.665191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.675868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1067/2126] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:42.679909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.690584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9337170-bb32-4036-9f1a-a9234bdb1961 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.695891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35763ff6-aa94-463a-9dad-d4d1e2ed6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.696554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763ff6-aa94-463a-9dad-d4d1e2ed6d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.696856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763ff6-aa94-463a-9dad-d4d1e2ed6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.697156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763ff6-aa94-463a-9dad-d4d1e2ed6d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.698051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763ff6-aa94-463a-9dad-d4d1e2ed6d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.699585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763ff6-aa94-463a-9dad-d4d1e2ed6d5d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.710037 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1060/2127] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:42.714881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.724835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676bc12-18e3-4b87-ab01-7aa67439ae46 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.730105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.731065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.731419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.731709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] PATH_INFO: `/v3/projects/8eff0a3185aa4e1e9f81afe01838fd0f/users/d4b5583643a041caa5c11dab230802fa/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.746216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eff0a3185aa4e1e9f81afe01838fd0f, user_id=d4b5583643a041caa5c11dab230802fa, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.748932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.751205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:42.765875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1068/2128] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:42 2022] PUT /identity/v3/projects/8eff0a3185aa4e1e9f81afe01838fd0f/users/d4b5583643a041caa5c11dab230802fa/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:42.777747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca188136-0e86-433b-9e92-6e0fd77fff6c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.778139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca188136-0e86-433b-9e92-6e0fd77fff6c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.778444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca188136-0e86-433b-9e92-6e0fd77fff6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.805094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-ca188136-0e86-433b-9e92-6e0fd77fff6c None None] MFA Rules not processed for user `d4b5583643a041caa5c11dab230802fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:42.806334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ca188136-0e86-433b-9e92-6e0fd77fff6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:42.811814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:42.878064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1061/2129] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:42.887362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:42.953292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2d72-3e5d-471f-8c55-840e6469a6a9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:42.958211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:42.958875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:42.959160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:42.959435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:42.960202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:42.962613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:42.987950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1069/2130] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:42 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:42.991966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca188136-0e86-433b-9e92-6e0fd77fff6c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:43.003736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca188136-0e86-433b-9e92-6e0fd77fff6c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:43.067234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:43.067903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.068191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.068469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.069162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:43.071621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:43.092183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1062/2131] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:42 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:43.096165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:43.107996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad02c8-e7d6-4389-ae70-087c90ffffda admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:43.113144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:43.113851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.114244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.114403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.115134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:43.117337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:43.129507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1070/2132] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:43.133344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:43.143929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16570a-820f-4cbb-bd75-f46ed54881d9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:43.149162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:43.150097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.150381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.150656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] PATH_INFO: `/v3/projects/f9d912e847b840d3823e22b96167df60/users/a882776e5a1c4807854177543db44429/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.171715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d912e847b840d3823e22b96167df60, user_id=a882776e5a1c4807854177543db44429, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:43.174878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:43.208982 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1063/2133] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:43 2022] PUT /identity/v3/projects/f9d912e847b840d3823e22b96167df60/users/a882776e5a1c4807854177543db44429/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:43.211180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:43.222243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d902228-f616-4a8d-9bed-9154bb8ae20b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:43.279653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7636ef-357b-497d-8170-f30a22f7b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:43.280270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7636ef-357b-497d-8170-f30a22f7b7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.280553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7636ef-357b-497d-8170-f30a22f7b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.280828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7636ef-357b-497d-8170-f30a22f7b7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.281585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7636ef-357b-497d-8170-f30a22f7b7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:43.283287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7636ef-357b-497d-8170-f30a22f7b7a9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:43.292835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1071/2134] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:43.296926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:43.307677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a29e9-a927-41fb-84fb-8483854f389b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:43.312254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:43.313122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.313402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.313710 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] PATH_INFO: `/v3/projects/f9d912e847b840d3823e22b96167df60/users/a882776e5a1c4807854177543db44429/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.315670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d912e847b840d3823e22b96167df60, user_id=a882776e5a1c4807854177543db44429, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:43.318311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:43.328975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1064/2135] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:43 2022] PUT /identity/v3/projects/f9d912e847b840d3823e22b96167df60/users/a882776e5a1c4807854177543db44429/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:43.339000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0dcb2-40c7-422d-a764-4816d0720216 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.339294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0dcb2-40c7-422d-a764-4816d0720216 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.339576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0dcb2-40c7-422d-a764-4816d0720216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.366257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-aff0dcb2-40c7-422d-a764-4816d0720216 None None] MFA Rules not processed for user `a882776e5a1c4807854177543db44429`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:43.367987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aff0dcb2-40c7-422d-a764-4816d0720216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:43.416760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:43.436810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1072/2136] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:43.447917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:43.449698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:43.505847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3099a-6e13-4fc7-a3a6-f41e9f3d90d8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:43.510107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eea6bc-011a-427c-a699-24fb6cfca339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:43.510749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eea6bc-011a-427c-a699-24fb6cfca339 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.511033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eea6bc-011a-427c-a699-24fb6cfca339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.511310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eea6bc-011a-427c-a699-24fb6cfca339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.520182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eea6bc-011a-427c-a699-24fb6cfca339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:43.521637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eea6bc-011a-427c-a699-24fb6cfca339 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:43.531028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1065/2137] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:43.908180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0dcb2-40c7-422d-a764-4816d0720216 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:43.968265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0dcb2-40c7-422d-a764-4816d0720216 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:43.973769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:43.974683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:43.974950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:43.975229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] PATH_INFO: `/v3/users/d4b5583643a041caa5c11dab230802fa` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:43.976995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b5583643a041caa5c11dab230802fa)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:43.978943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:44.023834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b5583643a041caa5c11dab230802fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.024489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b5583643a041caa5c11dab230802fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.032066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b5583643a041caa5c11dab230802fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.045007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b5583643a041caa5c11dab230802fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.045706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b5583643a041caa5c11dab230802fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.057804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1073/2138] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:43 2022] DELETE /identity/v3/users/d4b5583643a041caa5c11dab230802fa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:44.062094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:44.062459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:44.063364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:44.068796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:44.083015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:44.084221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:44.142938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1066/2139] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:44.152989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:44.154297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:44.248906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4fee7-1418-46f3-9483-186956231f4a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:44.254137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:44.254921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:44.255221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:44.255558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:44.267471 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:44.268979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:44.283142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1074/2140] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:44.564618 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:44.566350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:44.579457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764e6cb-e981-4044-8e46-badb0d196d00 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:44.584286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:44.585769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:44.586087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:44.586367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] PATH_INFO: `/v3/projects/8eff0a3185aa4e1e9f81afe01838fd0f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:44.587612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eff0a3185aa4e1e9f81afe01838fd0f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:44.589441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:44.636867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eff0a3185aa4e1e9f81afe01838fd0f', 'request_id': 'req-80c30ef5-3093-4f80-b004-b3376b2fa20e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.643199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eff0a3185aa4e1e9f81afe01838fd0f', 'request_id': 'req-80c30ef5-3093-4f80-b004-b3376b2fa20e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.650440 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eff0a3185aa4e1e9f81afe01838fd0f', 'request_id': 'req-80c30ef5-3093-4f80-b004-b3376b2fa20e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.660605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] The token cache is being invalidate because project 8eff0a3185aa4e1e9f81afe01838fd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:44.660889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.661537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.663054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1067/2141] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:44 2022] DELETE /identity/v3/projects/8eff0a3185aa4e1e9f81afe01838fd0f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:44.667068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:44.676602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea747b-696b-4961-8354-b2868adb6a26 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:44.684567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:44.734900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:44.735815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:44.736076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:44.736347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] PATH_INFO: `/v3/users/a882776e5a1c4807854177543db44429` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:44.737611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a882776e5a1c4807854177543db44429)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:44.739564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:44.793167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a882776e5a1c4807854177543db44429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.793847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a882776e5a1c4807854177543db44429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.800852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a882776e5a1c4807854177543db44429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.813211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a882776e5a1c4807854177543db44429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.813874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9003e310-5bb3-4c96-b8f4-50222e5aa669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a882776e5a1c4807854177543db44429'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:44.826604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1075/2142] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:44 2022] DELETE /identity/v3/users/a882776e5a1c4807854177543db44429 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:45.093578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.095093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:45.109675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30ef5-3093-4f80-b004-b3376b2fa20e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.169690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.170549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.170830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.171100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] PATH_INFO: `/v3/projects/f9d912e847b840d3823e22b96167df60` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.172253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d912e847b840d3823e22b96167df60)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.174214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.205654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:45.221849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d912e847b840d3823e22b96167df60', 'request_id': 'req-69254604-5ad2-4fe2-8dac-21c2806806cf'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:45.228526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d912e847b840d3823e22b96167df60', 'request_id': 'req-69254604-5ad2-4fe2-8dac-21c2806806cf'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:45.235340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d912e847b840d3823e22b96167df60', 'request_id': 'req-69254604-5ad2-4fe2-8dac-21c2806806cf'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:45.246489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] The token cache is being invalidate because project f9d912e847b840d3823e22b96167df60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:45.246775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:45.247402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69254604-5ad2-4fe2-8dac-21c2806806cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:45.249127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1068/2143] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:45 2022] DELETE /identity/v3/projects/f9d912e847b840d3823e22b96167df60 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:45.253842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae18a0b-24e5-4254-a754-2a2aa099433c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.254316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae18a0b-24e5-4254-a754-2a2aa099433c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.254515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae18a0b-24e5-4254-a754-2a2aa099433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.286982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9ae18a0b-24e5-4254-a754-2a2aa099433c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:45.288839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ae18a0b-24e5-4254-a754-2a2aa099433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:45.376014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1076/2144] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:45.383993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a5c5-9a71-493f-8661-3c67bcbfe12c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.384287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a5c5-9a71-493f-8661-3c67bcbfe12c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.384565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a5c5-9a71-493f-8661-3c67bcbfe12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.403081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2449a5c5-9a71-493f-8661-3c67bcbfe12c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:45.404289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2449a5c5-9a71-493f-8661-3c67bcbfe12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:45.415893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1069/2145] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:45.420387 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae18a0b-24e5-4254-a754-2a2aa099433c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.429921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae18a0b-24e5-4254-a754-2a2aa099433c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.434459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.435104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.435384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.435660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.436377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:45.436682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.438313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.449884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1077/2146] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:19:45.454131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449a5c5-9a71-493f-8661-3c67bcbfe12c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.465126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449a5c5-9a71-493f-8661-3c67bcbfe12c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.469811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.470474 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.470754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.471030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.471722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.473791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.501275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1070/2147] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:45 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:45.505686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.516063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721db88-b28b-4b5c-997d-686f45ff2086 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.529987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:45.579184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.579826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.580114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.580421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.581131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.583347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.603472 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1078/2148] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:45 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:45.607823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.618537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad387cce-a306-42e6-a8e0-54ee04af86bb admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.623186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.623837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.624120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.624420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.625144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.626791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.637152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1071/2149] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:45.641021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.651771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed252b-0644-4f9c-adfd-1e1b12cd91c6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.656892 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771cdd0-f7e0-4719-9a2c-f07aaffebe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.657591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771cdd0-f7e0-4719-9a2c-f07aaffebe11 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.657880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771cdd0-f7e0-4719-9a2c-f07aaffebe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.658156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771cdd0-f7e0-4719-9a2c-f07aaffebe11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.658884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771cdd0-f7e0-4719-9a2c-f07aaffebe11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.660499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771cdd0-f7e0-4719-9a2c-f07aaffebe11 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.670986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1079/2150] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:45.675119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.684844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a444d2-4a6c-4d06-913e-5788bfe8b320 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.689348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.690238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.690517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.690786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] PATH_INFO: `/v3/projects/4d85c47d818e4e83b50463033f67937d/users/c47ecd6b864643308d9018f5a4363d18/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.705181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d85c47d818e4e83b50463033f67937d, user_id=c47ecd6b864643308d9018f5a4363d18, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.708324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.721327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1072/2151] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:45 2022] PUT /identity/v3/projects/4d85c47d818e4e83b50463033f67937d/users/c47ecd6b864643308d9018f5a4363d18/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:45.733308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7b11-497c-4267-99d3-8e5453f971e5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.733629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7b11-497c-4267-99d3-8e5453f971e5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.733906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7b11-497c-4267-99d3-8e5453f971e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.760356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-533b7b11-497c-4267-99d3-8e5453f971e5 None None] MFA Rules not processed for user `c47ecd6b864643308d9018f5a4363d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:45.761625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-533b7b11-497c-4267-99d3-8e5453f971e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:45.823801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1080/2152] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:45.828234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.889083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040b3c5-611c-4c8d-8fa7-d5f38d9109d6 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.893594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.894245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.894529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.894802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.895479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.897357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:45.922178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1073/2153] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:45 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:45.926205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7b11-497c-4267-99d3-8e5453f971e5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:45.937037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7b11-497c-4267-99d3-8e5453f971e5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:45.992421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:45.993074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:45.993357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:45.993660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:45.994344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:45.996240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:46.016975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1081/2154] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:45 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:19:46.020924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:46.031731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effafd7d-fdff-4efc-a31f-fc991890d0fa admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:46.036337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:46.037011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:46.037298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:46.037615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:46.038356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:46.039943 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:46.051243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1074/2155] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:46.055032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:46.064670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf07698-d629-4041-b5c1-a0ea403fabcc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:46.069150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:46.070555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:46.070834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:46.071107 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] PATH_INFO: `/v3/projects/23248d5b665c43c38316385f2580529f/users/c1d19c183e8f4dbe9322aa01ed7b7ff2/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:46.084909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:46.089104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23248d5b665c43c38316385f2580529f, user_id=c1d19c183e8f4dbe9322aa01ed7b7ff2, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:46.092113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:46.107620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1082/2156] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:46 2022] PUT /identity/v3/projects/23248d5b665c43c38316385f2580529f/users/c1d19c183e8f4dbe9322aa01ed7b7ff2/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:46.111465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:46.122072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60f0b3-4866-459b-a28f-67e62222574e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:46.147327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:46.189690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e9b61-4053-4f1f-913b-a430c4a72f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:46.190370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e9b61-4053-4f1f-913b-a430c4a72f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:46.190656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e9b61-4053-4f1f-913b-a430c4a72f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:46.190935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e9b61-4053-4f1f-913b-a430c4a72f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:46.191669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e9b61-4053-4f1f-913b-a430c4a72f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:46.193311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e9b61-4053-4f1f-913b-a430c4a72f01 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:46.207305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1075/2157] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:46.208703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:46.219655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320a35f-cde7-4346-a78a-77f530931a7b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:46.224219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:46.225087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:46.225365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:46.225667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] PATH_INFO: `/v3/projects/23248d5b665c43c38316385f2580529f/users/c1d19c183e8f4dbe9322aa01ed7b7ff2/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:46.227624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23248d5b665c43c38316385f2580529f, user_id=c1d19c183e8f4dbe9322aa01ed7b7ff2, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:46.236370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:46.240618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1083/2158] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:46 2022] PUT /identity/v3/projects/23248d5b665c43c38316385f2580529f/users/c1d19c183e8f4dbe9322aa01ed7b7ff2/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:46.251316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:46.251615 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:46.251895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:46.278280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] MFA Rules not processed for user `c1d19c183e8f4dbe9322aa01ed7b7ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:46.279488 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:46.355317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1076/2159] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:46.390583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:46.395026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:46.463291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e773-6771-45fe-b41b-01da7e5da46a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:46.468093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8b946-a566-4c66-8cfb-7470673dfbbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:46.468779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8b946-a566-4c66-8cfb-7470673dfbbb service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:46.469065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8b946-a566-4c66-8cfb-7470673dfbbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:46.469344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8b946-a566-4c66-8cfb-7470673dfbbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:46.532830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8b946-a566-4c66-8cfb-7470673dfbbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:46.534376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8b946-a566-4c66-8cfb-7470673dfbbb service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:46.544396 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1084/2160] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:54.126245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:54.127733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:54.200863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf04c5e-e297-44e6-89b0-d918bd1b658a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:54.205326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:54.206205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:54.206491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:54.206789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] PATH_INFO: `/v3/users/018119c0b37347e7a5e6876d82404a14` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:54.208364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018119c0b37347e7a5e6876d82404a14)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:54.210317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:54.263090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018119c0b37347e7a5e6876d82404a14'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:54.263914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018119c0b37347e7a5e6876d82404a14'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:54.269136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:54.283422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018119c0b37347e7a5e6876d82404a14'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:54.284175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018119c0b37347e7a5e6876d82404a14'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:54.294954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018119c0b37347e7a5e6876d82404a14'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:54.316158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1077/2161] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:54 2022] DELETE /identity/v3/users/018119c0b37347e7a5e6876d82404a14 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:54.323566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:54.324112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:54.324112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:54.345066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:54.346390 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:54.455547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1085/2162] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:54.466201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:54.467672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:54.538670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf169dc9-970f-43c2-b813-b533b716f515 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:54.543320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:54.543968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:54.544245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:54.544526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:54.554362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:54.555798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:54.565515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1078/2163] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:54.968498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:54.970009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:54.987360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1b0e5-4e3f-4912-87f6-8fb4279967b1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:54.996152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:54.998265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:54.998588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:54.998874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] PATH_INFO: `/v3/projects/b1039b51b8b24694a3650a87e8a4d4eb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:55.000334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1039b51b8b24694a3650a87e8a4d4eb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:55.003124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:55.071080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:55.104721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1039b51b8b24694a3650a87e8a4d4eb', 'request_id': 'req-7f332321-1d6a-45bf-8e57-3393fec2d920'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.124322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1039b51b8b24694a3650a87e8a4d4eb', 'request_id': 'req-7f332321-1d6a-45bf-8e57-3393fec2d920'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.145120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1039b51b8b24694a3650a87e8a4d4eb', 'request_id': 'req-7f332321-1d6a-45bf-8e57-3393fec2d920'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.167910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] The token cache is being invalidate because project b1039b51b8b24694a3650a87e8a4d4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:55.168983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.169811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.174154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1086/2164] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:54 2022] DELETE /identity/v3/projects/b1039b51b8b24694a3650a87e8a4d4eb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:55.175602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:55.188110 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbb4a1-1194-4238-9a59-9c3a5fb9cf5c service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:55.271693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:55.273181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:55.273529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:55.273811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] PATH_INFO: `/v3/users/71ba605b79df4c3b99839f1d171f72c9` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:55.275651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ba605b79df4c3b99839f1d171f72c9)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:55.277941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:55.339282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ba605b79df4c3b99839f1d171f72c9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.340212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ba605b79df4c3b99839f1d171f72c9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.360127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ba605b79df4c3b99839f1d171f72c9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.360845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ba605b79df4c3b99839f1d171f72c9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.368443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ba605b79df4c3b99839f1d171f72c9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.369687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:55.382781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1079/2165] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:55 2022] DELETE /identity/v3/users/71ba605b79df4c3b99839f1d171f72c9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:55.702119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:55.703990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:55.720285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332321-1d6a-45bf-8e57-3393fec2d920 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:55.784343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:55.785417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:55.785886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:55.786202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] PATH_INFO: `/v3/projects/a2180511eb5548468cb9941800c8a2b8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:55.787733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2180511eb5548468cb9941800c8a2b8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:55.790013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:55.838011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2180511eb5548468cb9941800c8a2b8', 'request_id': 'req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.847618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2180511eb5548468cb9941800c8a2b8', 'request_id': 'req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.855298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2180511eb5548468cb9941800c8a2b8', 'request_id': 'req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.865928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] The token cache is being invalidate because project a2180511eb5548468cb9941800c8a2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:55.866741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.867397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.868908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1087/2166] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:55 2022] DELETE /identity/v3/projects/a2180511eb5548468cb9941800c8a2b8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:55.872698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:55.874123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:55.887656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699328e-a02d-4beb-8a5a-0fc32c6555e6 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:55.943693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:55.945201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:55.945557 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:55.945836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] PATH_INFO: `/v3/users/a5ec8b92841e4326b39a456b9496be79` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:55.947106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ec8b92841e4326b39a456b9496be79)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:55.950165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:55.996403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ec8b92841e4326b39a456b9496be79'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:55.997036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ec8b92841e4326b39a456b9496be79'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.009063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ec8b92841e4326b39a456b9496be79'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.009707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ec8b92841e4326b39a456b9496be79'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.017231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-74cdcd71-6f5a-4e41-b2d4-8f2af939c7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ec8b92841e4326b39a456b9496be79'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.029601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1080/2167] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:55 2022] DELETE /identity/v3/users/a5ec8b92841e4326b39a456b9496be79 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:19:56.299754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:56.301241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:56.316016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa9bc4-4658-4a19-951f-c61bd20f0ecb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:56.369103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:56.385093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:56.386002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.386691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.387071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] PATH_INFO: `/v3/projects/ece70165b20d4a73a54a42191208de05` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.388433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece70165b20d4a73a54a42191208de05)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:56.391068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:56.442870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece70165b20d4a73a54a42191208de05', 'request_id': 'req-88c8a775-364b-422b-926d-e87a7a4b9664'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.451495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece70165b20d4a73a54a42191208de05', 'request_id': 'req-88c8a775-364b-422b-926d-e87a7a4b9664'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.459005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece70165b20d4a73a54a42191208de05', 'request_id': 'req-88c8a775-364b-422b-926d-e87a7a4b9664'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.469936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] The token cache is being invalidate because project ece70165b20d4a73a54a42191208de05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:56.470221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.470964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88c8a775-364b-422b-926d-e87a7a4b9664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:56.472493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1088/2168] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:56 2022] DELETE /identity/v3/projects/ece70165b20d4a73a54a42191208de05 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:56.480154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925c77-3187-4ad3-ba50-0137aee566bb None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.480658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925c77-3187-4ad3-ba50-0137aee566bb None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.480764 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925c77-3187-4ad3-ba50-0137aee566bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.499024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c9925c77-3187-4ad3-ba50-0137aee566bb None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:56.500246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c9925c77-3187-4ad3-ba50-0137aee566bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:56.568380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1081/2169] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:56.576170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffa62-2ec3-41b8-b7c6-1b805a87cd96 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.576456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffa62-2ec3-41b8-b7c6-1b805a87cd96 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.576733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffa62-2ec3-41b8-b7c6-1b805a87cd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.594955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-927ffa62-2ec3-41b8-b7c6-1b805a87cd96 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:56.596143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-927ffa62-2ec3-41b8-b7c6-1b805a87cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:56.604336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1089/2170] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:56.608563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9925c77-3187-4ad3-ba50-0137aee566bb None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:56.618909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9925c77-3187-4ad3-ba50-0137aee566bb None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:56.623517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:56.624104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.624388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.624672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.625454 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:19:56.625846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:56.627436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:56.629826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:56.644814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1082/2171] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:19:56.645936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ffa62-2ec3-41b8-b7c6-1b805a87cd96 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:56.656092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ffa62-2ec3-41b8-b7c6-1b805a87cd96 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:56.660779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:56.661414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.661733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.662009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.662734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:56.665176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:56.689209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1090/2172] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:19:56 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:56.693202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:56.702945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a853e4-4ba5-44ba-ac9c-5158f55e14ee admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:56.758992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:56.759648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.759927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.760198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.760880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:56.762796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:56.781065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1083/2173] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:19:56 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:19:56.785103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:56.796149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c952-4943-4ff2-ae7e-57444606282b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:56.800772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:56.801428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.801820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.802097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.802823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:56.804418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:56.814947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1091/2174] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:19:56.818926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:56.829577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f9916-08d5-4ed3-8568-96c9b9a8febb admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:56.835776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce163413-02ea-4191-ab95-8c7fc93bb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:56.836882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163413-02ea-4191-ab95-8c7fc93bb63f admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.837223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163413-02ea-4191-ab95-8c7fc93bb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.837649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163413-02ea-4191-ab95-8c7fc93bb63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.843740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce163413-02ea-4191-ab95-8c7fc93bb63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:56.845537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce163413-02ea-4191-ab95-8c7fc93bb63f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:56.856670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1084/2175] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:19:56.860821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:56.870980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6ce1-ef7b-4c27-92e8-d75b32f01580 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:56.875936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:56.876751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.877034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.877310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] PATH_INFO: `/v3/projects/9e76654020af4f7daf0dc9c7a94f8a4c/users/a42029d5789548c0b56c5a6e69e0f80d/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.892283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e76654020af4f7daf0dc9c7a94f8a4c, user_id=a42029d5789548c0b56c5a6e69e0f80d, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:56.894971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:56.912701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1092/2176] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:19:56 2022] PUT /identity/v3/projects/9e76654020af4f7daf0dc9c7a94f8a4c/users/a42029d5789548c0b56c5a6e69e0f80d/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:56.918389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:56.918738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:56.919069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:56.938985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:56.940286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:57.000422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1085/2177] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:19:57.010455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:57.012248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:57.071971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93fb5-b0db-4d57-8aa1-ce4d6869d7be admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:57.075757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0d1b8-2dbe-4a6d-8d13-bad9dc722132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:57.076400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d1b8-2dbe-4a6d-8d13-bad9dc722132 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:57.076684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d1b8-2dbe-4a6d-8d13-bad9dc722132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:57.076967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d1b8-2dbe-4a6d-8d13-bad9dc722132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:57.087170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0d1b8-2dbe-4a6d-8d13-bad9dc722132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:57.088627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0d1b8-2dbe-4a6d-8d13-bad9dc722132 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:57.099116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1093/2178] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:57.947911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:57.949427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:57.967401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0618-ae5c-4d65-849c-077cf46e6183 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:57.977497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:57.981036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:57.981367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:57.981740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] PATH_INFO: `/v3/users/3ed6848d485d4e57bd5cb2dcca311373` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:57.983430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed6848d485d4e57bd5cb2dcca311373)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:57.985501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:58.096063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed6848d485d4e57bd5cb2dcca311373'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:58.098303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed6848d485d4e57bd5cb2dcca311373'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:58.126797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed6848d485d4e57bd5cb2dcca311373'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:58.127707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed6848d485d4e57bd5cb2dcca311373'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:58.133732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:58.139306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed6848d485d4e57bd5cb2dcca311373'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:58.164814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1086/2179] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:57 2022] DELETE /identity/v3/users/3ed6848d485d4e57bd5cb2dcca311373 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:58.166987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:58.167524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:58.167841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:58.192898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:19:58.194310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:58.208580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:58.371250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1094/2180] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:19:58.377648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:58.379129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:58.468528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:58.470599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:58.490642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebf32-37b4-4d6a-b20f-bbcc254dda39 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:58.496254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:58.497006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:58.497543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:58.497895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:58.510594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:58.512151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:58.529255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1087/2181] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:19:58.582541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e2e9-141a-4e23-a68b-326bced3c623 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:58.593264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:58.594710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:58.595005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:58.597617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:58.606800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:58.712132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:58.713890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:58.725758 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1095/2182] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:19:59.114403 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:59.116651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:19:59.148697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8d199-ff28-406f-90bb-fc8784f531dc service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:59.165262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:59.169733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:59.170749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:59.172616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] PATH_INFO: `/v3/projects/7498d8ae9eb541f793f16186f15ed44e` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:59.178958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7498d8ae9eb541f793f16186f15ed44e)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:59.181027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:59.286957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7498d8ae9eb541f793f16186f15ed44e', 'request_id': 'req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.297214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7498d8ae9eb541f793f16186f15ed44e', 'request_id': 'req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.311607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7498d8ae9eb541f793f16186f15ed44e', 'request_id': 'req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.325657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] The token cache is being invalidate because project 7498d8ae9eb541f793f16186f15ed44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:19:59.325657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.326481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.329300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1088/2183] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:19:59 2022] DELETE /identity/v3/projects/7498d8ae9eb541f793f16186f15ed44e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:19:59.333225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:19:59.360747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6034c-b30e-4b06-b9e7-230cdd2194bd service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:19:59.446198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:19:59.447627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:19:59.448197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:19:59.448736 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] PATH_INFO: `/v3/users/1b1c91f30a64426a821757f7fdfeedde` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:19:59.450596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1c91f30a64426a821757f7fdfeedde)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:19:59.453427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:19:59.468760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:59.521426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1c91f30a64426a821757f7fdfeedde'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.522121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1c91f30a64426a821757f7fdfeedde'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.531380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1c91f30a64426a821757f7fdfeedde'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.547128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1c91f30a64426a821757f7fdfeedde'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.548170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e3235414-de8e-43bd-a338-4079abaa4051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1c91f30a64426a821757f7fdfeedde'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:19:59.571101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1096/2184] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:19:59 2022] DELETE /identity/v3/users/1b1c91f30a64426a821757f7fdfeedde => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:00.124564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:00.126101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:00.143715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663186-d65f-48fa-aa5b-44a3c8e5a5e7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:00.286328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:00.287242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:00.287529 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:00.287842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] PATH_INFO: `/v3/projects/a1b57977522e412eb59a901d1e93a001` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:00.289202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b57977522e412eb59a901d1e93a001)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:00.291277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:00.337304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:00.404746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b57977522e412eb59a901d1e93a001', 'request_id': 'req-f8769ea2-6381-4fde-9ed0-da597b7ed513'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:00.420328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b57977522e412eb59a901d1e93a001', 'request_id': 'req-f8769ea2-6381-4fde-9ed0-da597b7ed513'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:00.446397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b57977522e412eb59a901d1e93a001', 'request_id': 'req-f8769ea2-6381-4fde-9ed0-da597b7ed513'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:00.464510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] The token cache is being invalidate because project a1b57977522e412eb59a901d1e93a001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:00.464906 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:00.469028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f8769ea2-6381-4fde-9ed0-da597b7ed513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:00.471085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1089/2185] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:00 2022] DELETE /identity/v3/projects/a1b57977522e412eb59a901d1e93a001 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:00.477345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78749d-5fb8-40a5-8d40-b85ab510d970 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:00.477806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78749d-5fb8-40a5-8d40-b85ab510d970 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:00.477949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78749d-5fb8-40a5-8d40-b85ab510d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:00.511321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9d78749d-5fb8-40a5-8d40-b85ab510d970 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:00.512811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9d78749d-5fb8-40a5-8d40-b85ab510d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:00.723086 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1097/2186] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:00.723818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1989b-6c9e-405c-b1ad-78d4d4f83d97 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:00.724215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1989b-6c9e-405c-b1ad-78d4d4f83d97 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:00.724599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1989b-6c9e-405c-b1ad-78d4d4f83d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:00.759492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-88e1989b-6c9e-405c-b1ad-78d4d4f83d97 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:00.760967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-88e1989b-6c9e-405c-b1ad-78d4d4f83d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:00.770665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1090/2187] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:00.775099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78749d-5fb8-40a5-8d40-b85ab510d970 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:00.791299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78749d-5fb8-40a5-8d40-b85ab510d970 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:00.797077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:00.797976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:00.798413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:00.798945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:00.800113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:20:00.800626 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:00.802658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:00.831449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1098/2188] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:20:00.841617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1989b-6c9e-405c-b1ad-78d4d4f83d97 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:00.858408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1989b-6c9e-405c-b1ad-78d4d4f83d97 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:00.868350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:00.869020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:00.869302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:00.869608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:00.870312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:00.874692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:00.920185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1091/2189] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:20:00 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:00.921376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:00.933327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd0c7-aa59-4272-8830-bc824a6c127b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:01.037515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:01.039608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:01.040178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:01.040670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:01.042924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:01.045421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:01.074692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1099/2190] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:20:00 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:01.075379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:01.090151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c9a57-a146-49fd-9497-5bf46f05d350 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:01.096501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:01.097386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:01.097790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:01.098329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:01.101135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:01.102935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:01.119394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1092/2191] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:01.120787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:01.128669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:01.135969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f65767-79ae-4876-bea0-6e2f091854ea admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:01.144500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fc87f-a762-4c1d-b48e-17d784568a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:01.146677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fc87f-a762-4c1d-b48e-17d784568a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:01.147992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fc87f-a762-4c1d-b48e-17d784568a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:01.148488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fc87f-a762-4c1d-b48e-17d784568a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:01.150161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fc87f-a762-4c1d-b48e-17d784568a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:01.152002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fc87f-a762-4c1d-b48e-17d784568a88 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:01.179514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1100/2192] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:01.184153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:01.196572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7577e-a36f-4557-8b5a-e745090feb9c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:01.201490 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:01.202519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:01.202802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:01.203077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] PATH_INFO: `/v3/projects/d6c4fb1654464eaab9c87641df5951cc/users/412740aac1bf451c8c92808b42a1c318/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:01.221697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c4fb1654464eaab9c87641df5951cc, user_id=412740aac1bf451c8c92808b42a1c318, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:01.224516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:01.244822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1093/2193] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:01 2022] PUT /identity/v3/projects/d6c4fb1654464eaab9c87641df5951cc/users/412740aac1bf451c8c92808b42a1c318/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:01.250229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dde9d-8ac3-4ca5-93b6-3d4cdda89c9d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:01.251721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dde9d-8ac3-4ca5-93b6-3d4cdda89c9d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:01.252002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dde9d-8ac3-4ca5-93b6-3d4cdda89c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:01.300603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-732dde9d-8ac3-4ca5-93b6-3d4cdda89c9d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:01.306698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-732dde9d-8ac3-4ca5-93b6-3d4cdda89c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:01.421031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1101/2194] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:20:01.431361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:01.435344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:01.520506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26deccb-af28-428f-b53b-5cfe57f54712 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:01.525781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f838f-56c8-4a94-9e53-376da17ea90e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:01.527076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f838f-56c8-4a94-9e53-376da17ea90e service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:01.527508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f838f-56c8-4a94-9e53-376da17ea90e service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:01.527928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f838f-56c8-4a94-9e53-376da17ea90e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:01.542383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f838f-56c8-4a94-9e53-376da17ea90e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:01.545093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f838f-56c8-4a94-9e53-376da17ea90e service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:01.576346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1094/2195] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:03.085248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.086173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.086596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.106538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.107446 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.107908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.167085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] MFA Rules not processed for user `412740aac1bf451c8c92808b42a1c318`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:03.168546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:03.169577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] MFA Rules not processed for user `a42029d5789548c0b56c5a6e69e0f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:03.170771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:03.235262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:03.285690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1102/2196] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:03.293019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:03.294971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1095/2197] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:03.299247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:03.300771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:03.301058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:03.325875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f03b79-55b5-4fd8-80da-e8c8ae8b4cbf None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:03.341747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:03.342382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.342673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.342947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.343649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:03.345992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:03.389092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a424-053b-4108-bd8e-20d130154928 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:03.393699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:03.394953 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.395334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.395939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.400761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1096/2198] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:20:03 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:20:03.401909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:03.413882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:03.417136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:03.429594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1103/2199] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:20:03.486381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d7661-7260-41f5-9123-5a7297f7a524 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:03.503609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:03.504322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.504590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.504865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.505604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:03.511852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:03.547800 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1097/2200] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:20:03 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:20:03.552122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:03.563470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3356aa-75e9-4fd1-b4fe-8f4488e78e46 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:03.574262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:03.574955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.575263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.575527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.576416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:03.578220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:03.590579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1104/2201] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:03.594759 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:03.606386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cacd83-0228-4fd3-8e03-0f8bed6825a9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:03.611546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:03.612435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.612715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.612988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] PATH_INFO: `/v3/projects/428f32d5fbf84e66919032f77aa7ead6/users/d195d0af25184c98a03a8beabb8a1a26/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.634472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428f32d5fbf84e66919032f77aa7ead6, user_id=d195d0af25184c98a03a8beabb8a1a26, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:03.637670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:03.661539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1098/2202] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:03 2022] PUT /identity/v3/projects/428f32d5fbf84e66919032f77aa7ead6/users/d195d0af25184c98a03a8beabb8a1a26/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:03.663878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:03.675482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb70b3-f809-463e-8e3b-bd03ee5b7920 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:03.689879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:03.759955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac952-a5a7-42e1-b0ff-2689f17a19d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:03.760870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac952-a5a7-42e1-b0ff-2689f17a19d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.761393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac952-a5a7-42e1-b0ff-2689f17a19d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.761653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac952-a5a7-42e1-b0ff-2689f17a19d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.762380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ac952-a5a7-42e1-b0ff-2689f17a19d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:03.764003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ac952-a5a7-42e1-b0ff-2689f17a19d2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:03.777536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1105/2203] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:03.779722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:03.792436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718ff5b-2f36-49b8-94c9-a79495a602e2 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:03.799190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:03.800165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:03.800515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:03.800919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] PATH_INFO: `/v3/projects/428f32d5fbf84e66919032f77aa7ead6/users/d195d0af25184c98a03a8beabb8a1a26/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:03.803279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=428f32d5fbf84e66919032f77aa7ead6, user_id=d195d0af25184c98a03a8beabb8a1a26, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:03.807974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:03.833533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1099/2204] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:03 2022] PUT /identity/v3/projects/428f32d5fbf84e66919032f77aa7ead6/users/d195d0af25184c98a03a8beabb8a1a26/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:06.187061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89a21-27e3-421d-b783-fd467d659cde None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:06.188117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89a21-27e3-421d-b783-fd467d659cde None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:06.188547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89a21-27e3-421d-b783-fd467d659cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:06.223502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9de89a21-27e3-421d-b783-fd467d659cde None None] MFA Rules not processed for user `412740aac1bf451c8c92808b42a1c318`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:06.225146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9de89a21-27e3-421d-b783-fd467d659cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:06.329403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1106/2205] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:09.575515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:09.577330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:09.683798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a295e1-e4f6-4047-b536-47aa0eebf9cf admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:09.690050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:09.691806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:09.692894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:09.693307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] PATH_INFO: `/v3/users/c47ecd6b864643308d9018f5a4363d18` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:09.694861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47ecd6b864643308d9018f5a4363d18)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:09.696834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:09.700183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:09.768245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47ecd6b864643308d9018f5a4363d18'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:09.769318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47ecd6b864643308d9018f5a4363d18'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:09.789076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47ecd6b864643308d9018f5a4363d18'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:09.790016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47ecd6b864643308d9018f5a4363d18'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:09.799096 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47ecd6b864643308d9018f5a4363d18'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:09.815153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1100/2206] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:20:09 2022] DELETE /identity/v3/users/c47ecd6b864643308d9018f5a4363d18 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:09.820253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a3f0-0a83-4965-b54c-95de1517c16e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:09.820762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a3f0-0a83-4965-b54c-95de1517c16e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:09.820850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a3f0-0a83-4965-b54c-95de1517c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:09.840193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7397a3f0-0a83-4965-b54c-95de1517c16e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:09.841524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7397a3f0-0a83-4965-b54c-95de1517c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:09.950535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1107/2207] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:09.961756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:09.963315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:10.097658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffbcda-9436-446c-84de-d5753787dd55 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:10.101280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:10.116717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:10.119328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:10.119726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:10.152863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:10.154370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:10.167719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1101/2208] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:10.482900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:10.483552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:10.484102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:10.569739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] MFA Rules not processed for user `d195d0af25184c98a03a8beabb8a1a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:10.575302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:10.698503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:10.720093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:10.721627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:10.748149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ca9fb-05f9-46a0-9301-484f184dc950 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:10.767993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:10.768959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:10.768959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:10.770153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] PATH_INFO: `/v3/users/307ae72eadb8423cb2693c0d99f69b57` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:10.788507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=307ae72eadb8423cb2693c0d99f69b57)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:10.795996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:10.809135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1108/2209] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:10.826791 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:10.828230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:10.948248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307ae72eadb8423cb2693c0d99f69b57'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:10.949073 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307ae72eadb8423cb2693c0d99f69b57'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:10.981909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307ae72eadb8423cb2693c0d99f69b57'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:10.983448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307ae72eadb8423cb2693c0d99f69b57'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:11.002292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-0b3ba8e9-f26c-49c7-b1bf-9edad6cde82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307ae72eadb8423cb2693c0d99f69b57'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:11.010296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:11.027702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1102/2210] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:20:10 2022] DELETE /identity/v3/users/307ae72eadb8423cb2693c0d99f69b57 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:11.032432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.032713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.032999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.062678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b5b07-e0b5-44fa-8f18-2e0cc51fa24e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:11.068308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:11.074522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.172893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf9fc-8b90-4643-8ce6-a8a830fe9c4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca9f55fa22844a31ba5bc9bff04ab67d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:11.174919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf9fc-8b90-4643-8ce6-a8a830fe9c4c service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.178866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf9fc-8b90-4643-8ce6-a8a830fe9c4c service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.180415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf9fc-8b90-4643-8ce6-a8a830fe9c4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.198207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-562bf9fc-8b90-4643-8ce6-a8a830fe9c4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.240065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1103/2211] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:20:11.285245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:11.288984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.328806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf9fc-8b90-4643-8ce6-a8a830fe9c4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:11.346857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf9fc-8b90-4643-8ce6-a8a830fe9c4c service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:11.388687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1109/2212] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:11.461537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed1656-94df-4a26-b7fc-4d5ec5289ef3 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:11.469731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668decf6-df00-4501-a2de-d50c8f91f10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:11.470756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668decf6-df00-4501-a2de-d50c8f91f10c service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.471232 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668decf6-df00-4501-a2de-d50c8f91f10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.471878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668decf6-df00-4501-a2de-d50c8f91f10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.487577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668decf6-df00-4501-a2de-d50c8f91f10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:11.489703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668decf6-df00-4501-a2de-d50c8f91f10c service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:11.503218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1104/2213] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:20:11.544808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca21ee-5654-4338-ad2b-80f2dd1f1012 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.545632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca21ee-5654-4338-ad2b-80f2dd1f1012 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.547357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca21ee-5654-4338-ad2b-80f2dd1f1012 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.549220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1110/2214] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:20:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:20:11.570771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186349f0-4d98-43af-b45c-3cb265a2cc0b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.571534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186349f0-4d98-43af-b45c-3cb265a2cc0b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.571534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186349f0-4d98-43af-b45c-3cb265a2cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.579945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca21ee-5654-4338-ad2b-80f2dd1f1012 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:11.581649 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fcca21ee-5654-4338-ad2b-80f2dd1f1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.610678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca21ee-5654-4338-ad2b-80f2dd1f1012 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:11.616591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:11.617830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.618527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.619191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] PATH_INFO: `/v3/projects/4d85c47d818e4e83b50463033f67937d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.620730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d85c47d818e4e83b50463033f67937d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:11.622678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-186349f0-4d98-43af-b45c-3cb265a2cc0b None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:11.623132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:11.624280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-186349f0-4d98-43af-b45c-3cb265a2cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.730880 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:11.732816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d85c47d818e4e83b50463033f67937d', 'request_id': 'req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:11.749336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d85c47d818e4e83b50463033f67937d', 'request_id': 'req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:11.752599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1105/2215] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:11.754330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.754719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.755140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.761262 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d85c47d818e4e83b50463033f67937d', 'request_id': 'req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:11.793127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] The token cache is being invalidate because project 4d85c47d818e4e83b50463033f67937d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:11.793560 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:11.797228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:11.799423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:11.802517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1111/2216] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:11 2022] DELETE /identity/v3/projects/4d85c47d818e4e83b50463033f67937d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:20:11.802517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:11.802517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.806020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.850927 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:11.899637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1106/2217] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:11.901137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:11.902885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.957174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b170-cdc5-4d74-b54f-8c45fb1f8dba admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:11.967645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:11.969185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:11.969950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:11.970654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:11.973634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:11.990145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:11.992771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:12.006041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1112/2218] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:12.007834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:12.015042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:12.020270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb8c8-4a7d-4fa9-85df-7297ad687ea7 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:12.031576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:12.032466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:12.032755 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:12.033039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] PATH_INFO: `/v3/users/c1d19c183e8f4dbe9322aa01ed7b7ff2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:12.034961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d19c183e8f4dbe9322aa01ed7b7ff2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:12.036922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:12.134293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417f7a7-502d-49f5-9e17-069b4ca530c9 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:12.136301 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d19c183e8f4dbe9322aa01ed7b7ff2'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.136992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d19c183e8f4dbe9322aa01ed7b7ff2'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.140738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:12.141684 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:12.142090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:12.142493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:12.144647 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:12.152017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d19c183e8f4dbe9322aa01ed7b7ff2'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.152732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d19c183e8f4dbe9322aa01ed7b7ff2'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.161569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:12.163670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d19c183e8f4dbe9322aa01ed7b7ff2'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.164133 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:12.201187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1113/2219] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:20:12.209540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1107/2220] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:20:11 2022] DELETE /identity/v3/users/c1d19c183e8f4dbe9322aa01ed7b7ff2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:12.442264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:12.445136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:12.472850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98588f81-9da5-4d88-83a6-cb6716df5bb8 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:12.541993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:12.557561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:12.558654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:12.558999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:12.559312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] PATH_INFO: `/v3/users/b89bb46a6c9f4ee29e1cb96db20387c1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:12.561948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89bb46a6c9f4ee29e1cb96db20387c1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:12.564648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:12.662383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89bb46a6c9f4ee29e1cb96db20387c1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.670825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89bb46a6c9f4ee29e1cb96db20387c1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.697333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89bb46a6c9f4ee29e1cb96db20387c1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.712477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:12.714039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:12.741037 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f0e46-dbdf-49f5-ba9a-05c2274a40c9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:12.743208 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89bb46a6c9f4ee29e1cb96db20387c1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.746222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f1284ea-4d79-4e31-a200-c6f121ef5fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89bb46a6c9f4ee29e1cb96db20387c1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.765648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:12.770569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:12.770848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:12.771191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] PATH_INFO: `/v3/projects/a490ae6f5c904e1090fcf2e285040906` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:12.777145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a490ae6f5c904e1090fcf2e285040906)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:12.779558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:12.809357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1114/2221] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:20:12 2022] DELETE /identity/v3/users/b89bb46a6c9f4ee29e1cb96db20387c1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:12.920048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a490ae6f5c904e1090fcf2e285040906', 'request_id': 'req-51284d68-18c4-40f1-ba00-642c4994c07d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.933596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a490ae6f5c904e1090fcf2e285040906', 'request_id': 'req-51284d68-18c4-40f1-ba00-642c4994c07d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.935708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:12.950209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a490ae6f5c904e1090fcf2e285040906', 'request_id': 'req-51284d68-18c4-40f1-ba00-642c4994c07d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.980003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] The token cache is being invalidate because project a490ae6f5c904e1090fcf2e285040906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:12.980347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.984667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-51284d68-18c4-40f1-ba00-642c4994c07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:12.986813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1108/2222] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:12 2022] DELETE /identity/v3/projects/a490ae6f5c904e1090fcf2e285040906 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:12.993076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3ac48-180f-46d3-8b9e-6fee0a80f7f5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:12.993718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3ac48-180f-46d3-8b9e-6fee0a80f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:12.993816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3ac48-180f-46d3-8b9e-6fee0a80f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.041675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a0c3ac48-180f-46d3-8b9e-6fee0a80f7f5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:13.049617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a0c3ac48-180f-46d3-8b9e-6fee0a80f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:13.137497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1115/2223] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:13.142923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a454-7f41-487a-9617-bb3cef4ec396 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.143434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a454-7f41-487a-9617-bb3cef4ec396 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.143925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a454-7f41-487a-9617-bb3cef4ec396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.174222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f978a454-7f41-487a-9617-bb3cef4ec396 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:13.176492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f978a454-7f41-487a-9617-bb3cef4ec396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:13.199648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1109/2224] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:13.202519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3ac48-180f-46d3-8b9e-6fee0a80f7f5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:13.213149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3ac48-180f-46d3-8b9e-6fee0a80f7f5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:13.227217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:13.228012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.228370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.228722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.229591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:20:13.230189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:13.234585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:13.254635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1116/2225] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:20:13.255868 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978a454-7f41-487a-9617-bb3cef4ec396 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:13.271520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978a454-7f41-487a-9617-bb3cef4ec396 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:13.279913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:13.282879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.283503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.284492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.285452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:13.288170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:13.351059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:13.353075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:13.373311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1110/2226] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:20:13 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:13.375048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:13.380673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb83b4a-e39c-47bd-8234-ef70935ec4c8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:13.502119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:13.503112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.503645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.504026 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] PATH_INFO: `/v3/projects/23248d5b665c43c38316385f2580529f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.505408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23248d5b665c43c38316385f2580529f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:13.508416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:13.510710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:13.543259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c20b-9a0f-4999-9a04-d7297c618103 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:13.548660 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:13.549366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.549713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.550109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.550830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:13.552899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:13.588955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1111/2227] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:20:13 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:13.588955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:13.588955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:13.591734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23248d5b665c43c38316385f2580529f', 'request_id': 'req-703530a4-6d9c-4382-85bd-4170738a120b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.601948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd4fe-47e9-4baa-9b02-9add99257d44 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:13.611401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23248d5b665c43c38316385f2580529f', 'request_id': 'req-703530a4-6d9c-4382-85bd-4170738a120b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.625004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23248d5b665c43c38316385f2580529f', 'request_id': 'req-703530a4-6d9c-4382-85bd-4170738a120b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.639851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] The token cache is being invalidate because project 23248d5b665c43c38316385f2580529f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:13.640631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.641482 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.644733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1117/2228] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:13 2022] DELETE /identity/v3/projects/23248d5b665c43c38316385f2580529f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:20:13.645854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:13.650909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:13.696480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:13.698091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.698091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.698325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] PATH_INFO: `/v3/projects/dd5f4016d8dc41e4995da741eb5d53f8` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.703977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5f4016d8dc41e4995da741eb5d53f8)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:13.706665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:13.764292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703530a4-6d9c-4382-85bd-4170738a120b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:13.767558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:INSERT=5,keystone:DELETE=6,keystone:SELECT=89 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:13.771770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5f4016d8dc41e4995da741eb5d53f8', 'request_id': 'req-cd05684a-6beb-491d-b686-96ac8b0eb76a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.782678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5f4016d8dc41e4995da741eb5d53f8', 'request_id': 'req-cd05684a-6beb-491d-b686-96ac8b0eb76a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.800954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5f4016d8dc41e4995da741eb5d53f8', 'request_id': 'req-cd05684a-6beb-491d-b686-96ac8b0eb76a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.841151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] The token cache is being invalidate because project dd5f4016d8dc41e4995da741eb5d53f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:13.841151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.849028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-cd05684a-6beb-491d-b686-96ac8b0eb76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:13.856441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1112/2229] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:13 2022] DELETE /identity/v3/projects/dd5f4016d8dc41e4995da741eb5d53f8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:13.857958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.858252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.858535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.885322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:13.886665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:13.937526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:13.937526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:13.937526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:13.937526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:13.938007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:13.938085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:13.982663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1118/2230] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:13.982663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:13.992276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.030314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef500-af53-4f3c-a385-4a6fc31a10a0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.043537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.044856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.045245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.045767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] PATH_INFO: `/v3/users/15b5f15066094c77995edbeaba76865c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.048961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b5f15066094c77995edbeaba76865c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.051031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.096980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1113/2231] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:14.098535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.111161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.114942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:14.146416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d747cf8-c156-477d-9ded-e5e24912995f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.156228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10758e-2c3a-4839-bb05-97b94c04bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.158550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10758e-2c3a-4839-bb05-97b94c04bd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.158990 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10758e-2c3a-4839-bb05-97b94c04bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.162282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10758e-2c3a-4839-bb05-97b94c04bd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.163935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10758e-2c3a-4839-bb05-97b94c04bd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.165765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10758e-2c3a-4839-bb05-97b94c04bd9d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.176837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b5f15066094c77995edbeaba76865c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.178245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b5f15066094c77995edbeaba76865c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.181774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1114/2232] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:14.184821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40553bba-be80-472f-8e25-ffd50c1421a8 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.185580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40553bba-be80-472f-8e25-ffd50c1421a8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.186076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40553bba-be80-472f-8e25-ffd50c1421a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.194346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b5f15066094c77995edbeaba76865c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.222689 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b5f15066094c77995edbeaba76865c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.223859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b5f15066094c77995edbeaba76865c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.233185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-40553bba-be80-472f-8e25-ffd50c1421a8 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:14.235414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-40553bba-be80-472f-8e25-ffd50c1421a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.244709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1119/2233] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:20:13 2022] DELETE /identity/v3/users/15b5f15066094c77995edbeaba76865c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:14.245704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.247118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.257559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1115/2234] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:14.263447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40553bba-be80-472f-8e25-ffd50c1421a8 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.306089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40553bba-be80-472f-8e25-ffd50c1421a8 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.421428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d91c-e3a0-4834-b6e5-29ce4ae5a5f6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.423347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.424025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.424308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.424583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.425318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:20:14.425655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.427278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.433969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbf0c0-a7de-40c1-a612-a6db6257b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.434892 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf0c0-a7de-40c1-a612-a6db6257b966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.435181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf0c0-a7de-40c1-a612-a6db6257b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.435463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf0c0-a7de-40c1-a612-a6db6257b966 admin admin] PATH_INFO: `/v3/projects/201cf842b6a240e79d797c1029258092/users/0a695e66b0144eba91b2080f65cbfbbd/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.453788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1116/2235] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:20:14.458248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.473386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05da0d7-b52c-48c6-ab12-e8eefaae41a8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.479566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.479816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbf0c0-a7de-40c1-a612-a6db6257b966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201cf842b6a240e79d797c1029258092, user_id=0a695e66b0144eba91b2080f65cbfbbd, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.480768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.481271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.481775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.482916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.483062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbf0c0-a7de-40c1-a612-a6db6257b966 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.485357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.511887 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1120/2236] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:14 2022] PUT /identity/v3/projects/201cf842b6a240e79d797c1029258092/users/0a695e66b0144eba91b2080f65cbfbbd/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:14.524416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee08cbb-d046-4233-8bcb-d5502c523f87 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.524740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee08cbb-d046-4233-8bcb-d5502c523f87 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.525065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee08cbb-d046-4233-8bcb-d5502c523f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.558055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1117/2237] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:20:14 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:20:14.562174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.605083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bee08cbb-d046-4233-8bcb-d5502c523f87 None None] MFA Rules not processed for user `0a695e66b0144eba91b2080f65cbfbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:14.608595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bee08cbb-d046-4233-8bcb-d5502c523f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.631135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:14.701407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486813f-9360-4037-b243-a5a3476e2b74 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.713714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.714400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.714679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.715543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.716263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.718204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.762510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1118/2238] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:20:14 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:14.762510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.764577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.772642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1121/2239] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:14.780323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee08cbb-d046-4233-8bcb-d5502c523f87 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.781833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0df8de-7940-44f5-8f90-9cf94e1ad2e4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.787537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.788463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.788804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.789159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] PATH_INFO: `/v3/projects/acc21823ea104815a0cb9488515a8676` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.790767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc21823ea104815a0cb9488515a8676)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.793215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.804305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee08cbb-d046-4233-8bcb-d5502c523f87 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:14.822851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:14.823654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:14.823937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:14.824407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:14.825234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:14.827193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:14.847237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1122/2240] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:14.849909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.850861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc21823ea104815a0cb9488515a8676', 'request_id': 'req-687ac022-5551-4a05-a786-9bb8748620d1'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.852358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.859155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc21823ea104815a0cb9488515a8676', 'request_id': 'req-687ac022-5551-4a05-a786-9bb8748620d1'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.863848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:14.872613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc21823ea104815a0cb9488515a8676', 'request_id': 'req-687ac022-5551-4a05-a786-9bb8748620d1'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.898674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] The token cache is being invalidate because project acc21823ea104815a0cb9488515a8676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:14.898967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.900331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:14.907053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1119/2241] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:14 2022] DELETE /identity/v3/projects/acc21823ea104815a0cb9488515a8676 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:14.908497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:14.910108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:14.927168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56317063-bb31-4fb4-829a-a19e70cd8c56 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.004806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac022-5551-4a05-a786-9bb8748620d1 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.008499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e36ba-3599-4f29-9f35-837cfab6621d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.009267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e36ba-3599-4f29-9f35-837cfab6621d service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.009676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e36ba-3599-4f29-9f35-837cfab6621d service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.010057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e36ba-3599-4f29-9f35-837cfab6621d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.013538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e13e36ba-3599-4f29-9f35-837cfab6621d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:15.014486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1164e9-2c78-45da-9dff-d049b2c902e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.016138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1164e9-2c78-45da-9dff-d049b2c902e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.017221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1164e9-2c78-45da-9dff-d049b2c902e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.017694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1164e9-2c78-45da-9dff-d049b2c902e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.019209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1164e9-2c78-45da-9dff-d049b2c902e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.021439 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1164e9-2c78-45da-9dff-d049b2c902e7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.053826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1120/2242] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:15.056553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746953-a957-4963-8c96-c2915e2dc5d4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.056702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746953-a957-4963-8c96-c2915e2dc5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.056948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746953-a957-4963-8c96-c2915e2dc5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.090206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-20746953-a957-4963-8c96-c2915e2dc5d4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:15.091421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-20746953-a957-4963-8c96-c2915e2dc5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:15.097078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e36ba-3599-4f29-9f35-837cfab6621d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.099122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e36ba-3599-4f29-9f35-837cfab6621d service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.110608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1121/2243] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:15.118582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20746953-a957-4963-8c96-c2915e2dc5d4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.128663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1123/2244] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:15.130950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdefe4-534c-4039-9f43-2eff00e65c7c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.131461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdefe4-534c-4039-9f43-2eff00e65c7c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.132596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdefe4-534c-4039-9f43-2eff00e65c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.142370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20746953-a957-4963-8c96-c2915e2dc5d4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.154302 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5abdefe4-534c-4039-9f43-2eff00e65c7c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:15.155877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5abdefe4-534c-4039-9f43-2eff00e65c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:15.156219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4872388-7037-44b7-8c52-3fa0b6c7310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.157228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4872388-7037-44b7-8c52-3fa0b6c7310c admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.157531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4872388-7037-44b7-8c52-3fa0b6c7310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.157812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4872388-7037-44b7-8c52-3fa0b6c7310c admin admin] PATH_INFO: `/v3/projects/7c44f7254ae946b68df05f9187ebf5dc/users/614bf937b5f8402bb6afdd7d71ac24a4/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.167448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1124/2245] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:15.172327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdefe4-534c-4039-9f43-2eff00e65c7c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.184079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdefe4-534c-4039-9f43-2eff00e65c7c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.193412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4872388-7037-44b7-8c52-3fa0b6c7310c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c44f7254ae946b68df05f9187ebf5dc, user_id=614bf937b5f8402bb6afdd7d71ac24a4, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.198101 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4872388-7037-44b7-8c52-3fa0b6c7310c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.201583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.202785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.203429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.203867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.204997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:20:15.205619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.208264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.230149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1122/2246] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:15 2022] PUT /identity/v3/projects/7c44f7254ae946b68df05f9187ebf5dc/users/614bf937b5f8402bb6afdd7d71ac24a4/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:15.244400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1125/2247] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:20:15.244624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.244624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.244624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.247650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.258126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:15.273707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6e587-c1ba-4506-bcd2-6e4eba2e8606 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.305050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] MFA Rules not processed for user `614bf937b5f8402bb6afdd7d71ac24a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:15.311131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:15.390452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:15.400820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.402135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.402782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.403903 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.405706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.409140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.461727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1126/2248] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:20:15 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:15.463216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.496701 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1123/2249] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:20:15.511404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.513257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:15.586629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f11d5-db61-4fac-b272-88fe7f6f0a14 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.595165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.595853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.596143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.596421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.597136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.599446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.632659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1127/2250] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:20:15 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:15.635305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.646520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda54c-548f-4de5-9b7f-700823be974d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.652161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623c587-9072-4e21-9ab7-e5eafafb4db6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.662519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.664672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.665777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.666360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.667874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.669983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.689810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1128/2251] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:15.691527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.705950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1376-ef1f-46e8-8172-2ef7ccf2fff0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.731989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.732833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.733071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.733356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.734136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.742030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.769438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1129/2252] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:15.775677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca9f55fa22844a31ba5bc9bff04ab67d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.776347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.776664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.777247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.778907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:15.808532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113c5aa-3d2b-4add-96bc-1367f7984ea5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:15.828139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28f40b-bf50-4bf9-a9fa-1c93f14b0b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:15.829827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28f40b-bf50-4bf9-a9fa-1c93f14b0b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.830129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28f40b-bf50-4bf9-a9fa-1c93f14b0b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.830412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28f40b-bf50-4bf9-a9fa-1c93f14b0b0f admin admin] PATH_INFO: `/v3/projects/3440335fd80744a9a4f9bae597f1fcec/users/9644313ad76d43eda0a941b1f098ea84/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.884075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28f40b-bf50-4bf9-a9fa-1c93f14b0b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3440335fd80744a9a4f9bae597f1fcec, user_id=9644313ad76d43eda0a941b1f098ea84, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.887833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28f40b-bf50-4bf9-a9fa-1c93f14b0b0f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.926202 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1130/2253] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:15 2022] PUT /identity/v3/projects/3440335fd80744a9a4f9bae597f1fcec/users/9644313ad76d43eda0a941b1f098ea84/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:15.928856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce4708-6373-4f1a-bcfa-7dfc3bc469b8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:15.929156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce4708-6373-4f1a-bcfa-7dfc3bc469b8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:15.929441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce4708-6373-4f1a-bcfa-7dfc3bc469b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:15.961364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:15.962874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:15.974011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-95ce4708-6373-4f1a-bcfa-7dfc3bc469b8 None None] MFA Rules not processed for user `9644313ad76d43eda0a941b1f098ea84`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:15.975788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-95ce4708-6373-4f1a-bcfa-7dfc3bc469b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:16.001058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1124/2254] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:20:16.165132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1131/2255] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:16.170115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:16.185677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00db4d5-1178-4ccd-ae7a-6961fa5cb6c1 service glance] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:16.190017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:16.296546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:16.297222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:16.297538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:16.297960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:16.298822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:16.302337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:16.365756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1125/2256] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:20:16 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:16.369659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce4708-6373-4f1a-bcfa-7dfc3bc469b8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:16.393698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce4708-6373-4f1a-bcfa-7dfc3bc469b8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:16.424817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:16.532868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:16.534542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:16.534848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:16.535134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:16.536717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:16.539371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:16.581765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1132/2257] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:20:16 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:16.581988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:16.596726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ec8c-8a3f-4bbe-b8fe-33961e58d6c2 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:16.602726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:16.603401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:16.603681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:16.603956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:16.604688 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:16.606614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:16.619950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1126/2258] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:16.625211 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:16.655470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0471-6ea8-441c-8ccc-a60c25b16f47 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:16.674180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:16.679277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:16.679576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:16.679859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] PATH_INFO: `/v3/projects/102e03ea94e04f85961d6132919d1cd7/users/20101f6bdd934bab9ad26a70d1487fe4/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:16.725895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=102e03ea94e04f85961d6132919d1cd7, user_id=20101f6bdd934bab9ad26a70d1487fe4, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:16.728562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:16.766358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1133/2259] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:16 2022] PUT /identity/v3/projects/102e03ea94e04f85961d6132919d1cd7/users/20101f6bdd934bab9ad26a70d1487fe4/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:16.767003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:16.783371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ea75-b9d0-4117-b737-473bf1511c33 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:16.969177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997b3d-94ec-4018-9220-c6b242c698d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:16.970046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997b3d-94ec-4018-9220-c6b242c698d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:16.970290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997b3d-94ec-4018-9220-c6b242c698d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:16.970595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997b3d-94ec-4018-9220-c6b242c698d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:16.971285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9997b3d-94ec-4018-9220-c6b242c698d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:16.976893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9997b3d-94ec-4018-9220-c6b242c698d2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:16.996462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1127/2260] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:17.001432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:17.047910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3169f-b77e-4b49-bdee-e71cbc413dba admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:17.065569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:17.066604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:17.067087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:17.067468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] PATH_INFO: `/v3/projects/102e03ea94e04f85961d6132919d1cd7/users/20101f6bdd934bab9ad26a70d1487fe4/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:17.071291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] RBAC: Authorizing `identity:create_grant(project_id=102e03ea94e04f85961d6132919d1cd7, user_id=20101f6bdd934bab9ad26a70d1487fe4, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:17.074207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:17.093524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1134/2261] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:17 2022] PUT /identity/v3/projects/102e03ea94e04f85961d6132919d1cd7/users/20101f6bdd934bab9ad26a70d1487fe4/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:17.102963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2972c6b-0a91-4218-9a62-8b1a87b2c493 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:17.103678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2972c6b-0a91-4218-9a62-8b1a87b2c493 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:17.104738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2972c6b-0a91-4218-9a62-8b1a87b2c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:17.169279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d2972c6b-0a91-4218-9a62-8b1a87b2c493 None None] MFA Rules not processed for user `20101f6bdd934bab9ad26a70d1487fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:17.170816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d2972c6b-0a91-4218-9a62-8b1a87b2c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:17.341326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1128/2262] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:17.355085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:17.359098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:17.519362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7db10-dec0-497e-becb-11ab3a9f808c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:17.527607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622ec42-3aa0-426d-bd31-ab44dbefa3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:17.528324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622ec42-3aa0-426d-bd31-ab44dbefa3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:17.529839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622ec42-3aa0-426d-bd31-ab44dbefa3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:17.531285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622ec42-3aa0-426d-bd31-ab44dbefa3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:17.728170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622ec42-3aa0-426d-bd31-ab44dbefa3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:17.729752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622ec42-3aa0-426d-bd31-ab44dbefa3e1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:17.759733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1135/2263] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:21.895749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2972c6b-0a91-4218-9a62-8b1a87b2c493 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:21.903883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:21.999443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2972c6b-0a91-4218-9a62-8b1a87b2c493 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:22.007023 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:22.008313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:22.008770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:22.009075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] PATH_INFO: `/v3/users/9644313ad76d43eda0a941b1f098ea84` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:22.010412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9644313ad76d43eda0a941b1f098ea84)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:22.012536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:22.167410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9644313ad76d43eda0a941b1f098ea84'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:22.168426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9644313ad76d43eda0a941b1f098ea84'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:22.187208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9644313ad76d43eda0a941b1f098ea84'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:22.188285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9644313ad76d43eda0a941b1f098ea84'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:22.198611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9644313ad76d43eda0a941b1f098ea84'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:22.218948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1129/2264] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:20:21 2022] DELETE /identity/v3/users/9644313ad76d43eda0a941b1f098ea84 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:22.223582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:22.224120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:22.224346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:22.249168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:22.250862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:22.271879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:22.333555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1136/2265] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:20:22.343293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:22.344729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:22.424970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c171-302d-4268-b7e7-a0ccf4f7e026 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:22.432152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:22.432961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:22.433249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:22.433554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:22.444663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:22.446134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:22.462567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1130/2266] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:22.903323 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:22.905201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:22.935957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69e2a2-8258-4bae-9c05-492b4cd31130 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:22.945946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:22.946819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:22.947120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:22.947398 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] PATH_INFO: `/v3/projects/3440335fd80744a9a4f9bae597f1fcec` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:22.948942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3440335fd80744a9a4f9bae597f1fcec)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:22.950935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:23.019216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3440335fd80744a9a4f9bae597f1fcec', 'request_id': 'req-103a58ad-547b-48d0-855d-2df1ab148525'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.034946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3440335fd80744a9a4f9bae597f1fcec', 'request_id': 'req-103a58ad-547b-48d0-855d-2df1ab148525'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.051260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3440335fd80744a9a4f9bae597f1fcec', 'request_id': 'req-103a58ad-547b-48d0-855d-2df1ab148525'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.071249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] The token cache is being invalidate because project 3440335fd80744a9a4f9bae597f1fcec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:23.071708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.072810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.078319 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1137/2267] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:22 2022] DELETE /identity/v3/projects/3440335fd80744a9a4f9bae597f1fcec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:23.079528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:23.100469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145f36-e2f9-4381-ae81-1e9ad2292d18 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:23.134590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:23.215515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:23.216462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:23.216935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:23.217159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] PATH_INFO: `/v3/users/20101f6bdd934bab9ad26a70d1487fe4` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:23.219044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20101f6bdd934bab9ad26a70d1487fe4)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:23.222822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:23.289354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20101f6bdd934bab9ad26a70d1487fe4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.290235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20101f6bdd934bab9ad26a70d1487fe4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.304321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20101f6bdd934bab9ad26a70d1487fe4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.304873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20101f6bdd934bab9ad26a70d1487fe4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.316698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-f66ca3d4-497c-4829-964a-6466242f7022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20101f6bdd934bab9ad26a70d1487fe4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:23.339001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1131/2268] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:20:23 2022] DELETE /identity/v3/users/20101f6bdd934bab9ad26a70d1487fe4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:23.933274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:23.934554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:23.955941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a58ad-547b-48d0-855d-2df1ab148525 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:24.045219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:24.046639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.047230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.047694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] PATH_INFO: `/v3/projects/102e03ea94e04f85961d6132919d1cd7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.049217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102e03ea94e04f85961d6132919d1cd7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:24.052294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:24.115113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:24.117261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102e03ea94e04f85961d6132919d1cd7', 'request_id': 'req-8fc6341d-382e-450d-a3ce-11f1499de1b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:24.134819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102e03ea94e04f85961d6132919d1cd7', 'request_id': 'req-8fc6341d-382e-450d-a3ce-11f1499de1b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:24.150789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102e03ea94e04f85961d6132919d1cd7', 'request_id': 'req-8fc6341d-382e-450d-a3ce-11f1499de1b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:24.164201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] The token cache is being invalidate because project 102e03ea94e04f85961d6132919d1cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:20:24.164561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:24.165266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8fc6341d-382e-450d-a3ce-11f1499de1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:20:24.172640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1138/2269] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:20:23 2022] DELETE /identity/v3/projects/102e03ea94e04f85961d6132919d1cd7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:24.176391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9c85f-39a9-4a0c-babf-2f12dfed5c5c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.176900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9c85f-39a9-4a0c-babf-2f12dfed5c5c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.177206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9c85f-39a9-4a0c-babf-2f12dfed5c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.201081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-51b9c85f-39a9-4a0c-babf-2f12dfed5c5c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:24.202396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-51b9c85f-39a9-4a0c-babf-2f12dfed5c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:24.306230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39f66-0bc6-4c96-b8f3-0c969f576c72 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.306864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39f66-0bc6-4c96-b8f3-0c969f576c72 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.307563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39f66-0bc6-4c96-b8f3-0c969f576c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.310673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1132/2270] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:24.363775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-08d39f66-0bc6-4c96-b8f3-0c969f576c72 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:24.365091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-08d39f66-0bc6-4c96-b8f3-0c969f576c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:24.382984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1139/2271] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:24.387836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9c85f-39a9-4a0c-babf-2f12dfed5c5c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:24.403731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9c85f-39a9-4a0c-babf-2f12dfed5c5c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:24.409873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:24.410053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.410381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.410658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.411392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:20:24.411941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:24.418692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:24.446455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d39f66-0bc6-4c96-b8f3-0c969f576c72 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:24.453887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1133/2272] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:20:24.458752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d39f66-0bc6-4c96-b8f3-0c969f576c72 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:24.480544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:24.481444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.481915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.482350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.483212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:24.485434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:24.544466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1140/2273] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:20:24 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:24.550012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:24.563896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5ce1-771a-4152-a792-683b50b00bbb admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:24.616329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:24.660055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:24.660841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.661227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.661607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.662590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:24.664626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:24.696889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1134/2274] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:20:24 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:20:24.698367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:24.712573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f97d89-b868-4080-99da-89dab12b4cc0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:24.717914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:24.718586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.718870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.719143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.719868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:24.721487 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:24.742182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1141/2275] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:24.743452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:24.762512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd270d-3203-41fb-a046-436c7860396b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:24.772029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9be6c9-ea76-471e-9ed9-2b7c3cd69ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:24.772794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be6c9-ea76-471e-9ed9-2b7c3cd69ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.773665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be6c9-ea76-471e-9ed9-2b7c3cd69ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.774011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be6c9-ea76-471e-9ed9-2b7c3cd69ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.775606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9be6c9-ea76-471e-9ed9-2b7c3cd69ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:24.777412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9be6c9-ea76-471e-9ed9-2b7c3cd69ea0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:24.804436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1135/2276] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:20:24.811508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:24.823079 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7343267-aa15-4c41-956c-bd06c73b343e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:24.828195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:24.829084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.829378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.829686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] PATH_INFO: `/v3/projects/45326c5e651a410b8eb85aa1f6faca5a/users/72820d12d73d48e4b07e5e860f3cee4f/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.846159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=45326c5e651a410b8eb85aa1f6faca5a, user_id=72820d12d73d48e4b07e5e860f3cee4f, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:24.848806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:24.865342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1142/2277] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:20:24 2022] PUT /identity/v3/projects/45326c5e651a410b8eb85aa1f6faca5a/users/72820d12d73d48e4b07e5e860f3cee4f/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:20:24.877516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644f32-0476-4557-83ca-6fc56118917a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:24.877516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644f32-0476-4557-83ca-6fc56118917a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:24.878165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644f32-0476-4557-83ca-6fc56118917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:24.908015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-18644f32-0476-4557-83ca-6fc56118917a None None] MFA Rules not processed for user `72820d12d73d48e4b07e5e860f3cee4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:24.909231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-18644f32-0476-4557-83ca-6fc56118917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:24.987828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1136/2278] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:24.996366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:24.999820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:25.084180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e227f-e785-4134-b898-72f18a7ecedb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:25.087943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d70b68-6481-42d8-b16f-38cc30aae0e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:25.089162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d70b68-6481-42d8-b16f-38cc30aae0e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:25.089162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d70b68-6481-42d8-b16f-38cc30aae0e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:25.089162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d70b68-6481-42d8-b16f-38cc30aae0e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:25.102117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d70b68-6481-42d8-b16f-38cc30aae0e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:25.103956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d70b68-6481-42d8-b16f-38cc30aae0e5 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:25.117375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1143/2279] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:20:26.385099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:26.385661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:26.385757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:26.402855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] MFA Rules not processed for user `a42029d5789548c0b56c5a6e69e0f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:26.404044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:26.460642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1137/2280] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:30.894492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384bc64-f913-48ba-a45d-3340d6142c01 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:30.895174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384bc64-f913-48ba-a45d-3340d6142c01 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:30.895174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384bc64-f913-48ba-a45d-3340d6142c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:30.921769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d384bc64-f913-48ba-a45d-3340d6142c01 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:30.923527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d384bc64-f913-48ba-a45d-3340d6142c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:30.992737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1144/2281] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:31.005296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:31.007483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:31.061156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:31.090842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9192c-23da-4915-8e82-2da565e25bc2 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:31.096129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea3d40-7511-4fc6-beb2-25f18880cf14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:31.096767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea3d40-7511-4fc6-beb2-25f18880cf14 service swift] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:31.097054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea3d40-7511-4fc6-beb2-25f18880cf14 service swift] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:31.097335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea3d40-7511-4fc6-beb2-25f18880cf14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:31.107894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea3d40-7511-4fc6-beb2-25f18880cf14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:31.109511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea3d40-7511-4fc6-beb2-25f18880cf14 service swift] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:31.118728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1138/2282] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:20:31.869204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:31.869702 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:31.870041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:31.893754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] MFA Rules not processed for user `72820d12d73d48e4b07e5e860f3cee4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:31.895668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:31.906083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1145/2283] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:20:41.114733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=12 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:41.885978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:55.971300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544aa45-8932-44ea-bc11-19666756f342 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:55.972283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544aa45-8932-44ea-bc11-19666756f342 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:55.972682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544aa45-8932-44ea-bc11-19666756f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:55.993257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c544aa45-8932-44ea-bc11-19666756f342 None None] MFA Rules not processed for user `412740aac1bf451c8c92808b42a1c318`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:20:55.996105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c544aa45-8932-44ea-bc11-19666756f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:56.065726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1139/2284] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:20:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:06.054548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=25 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:24.150919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:24.152464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:24.280096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b3da-7b2b-43a3-abae-4efda98d1b53 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:24.284837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:24.285948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:24.286236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:24.286517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] PATH_INFO: `/v3/users/0a695e66b0144eba91b2080f65cbfbbd` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:24.287748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a695e66b0144eba91b2080f65cbfbbd)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:24.289698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:24.338883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a695e66b0144eba91b2080f65cbfbbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:24.339549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a695e66b0144eba91b2080f65cbfbbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:24.347888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a695e66b0144eba91b2080f65cbfbbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:24.362063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a695e66b0144eba91b2080f65cbfbbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:24.362766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a695e66b0144eba91b2080f65cbfbbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:24.375974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1146/2285] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:21:24 2022] DELETE /identity/v3/users/0a695e66b0144eba91b2080f65cbfbbd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:24.380384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:24.380892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:24.381046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:24.410978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:24.412181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:24.477494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1140/2286] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:24.485785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:24.487203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:24.516325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:24.621177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106ceda-3cd1-4f50-907e-fa136ff4df23 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:24.624943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fed9e6-a71e-4f32-a6e3-14af76c914d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:24.625691 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed9e6-a71e-4f32-a6e3-14af76c914d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:24.625962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed9e6-a71e-4f32-a6e3-14af76c914d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:24.626235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed9e6-a71e-4f32-a6e3-14af76c914d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:24.637634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fed9e6-a71e-4f32-a6e3-14af76c914d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:24.639326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fed9e6-a71e-4f32-a6e3-14af76c914d6 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:24.653733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1147/2287] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:24.928853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:24.930423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:24.943229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bcc7-260f-4f85-9ed9-e19f80642b9f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:24.948883 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:24.949799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:24.950094 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:24.950407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] PATH_INFO: `/v3/projects/201cf842b6a240e79d797c1029258092` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:24.951583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=201cf842b6a240e79d797c1029258092)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:24.954046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.002630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201cf842b6a240e79d797c1029258092', 'request_id': 'req-b72418ce-8dda-4607-948d-3f8888e0e05f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.009068 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201cf842b6a240e79d797c1029258092', 'request_id': 'req-b72418ce-8dda-4607-948d-3f8888e0e05f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.021332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201cf842b6a240e79d797c1029258092', 'request_id': 'req-b72418ce-8dda-4607-948d-3f8888e0e05f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.036076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] The token cache is being invalidate because project 201cf842b6a240e79d797c1029258092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:21:25.036442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.036992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b72418ce-8dda-4607-948d-3f8888e0e05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.038564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1141/2288] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:21:24 2022] DELETE /identity/v3/projects/201cf842b6a240e79d797c1029258092 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:25.043421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8b93-9f79-4c63-94e1-de8365fc848f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.043742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8b93-9f79-4c63-94e1-de8365fc848f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.044025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8b93-9f79-4c63-94e1-de8365fc848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.081701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-63ab8b93-9f79-4c63-94e1-de8365fc848f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:25.083181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-63ab8b93-9f79-4c63-94e1-de8365fc848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:25.141978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1148/2289] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:25.149342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888640a9-d986-469a-96cc-1d703e501fe4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.149665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888640a9-d986-469a-96cc-1d703e501fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.149944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888640a9-d986-469a-96cc-1d703e501fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.167573 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-888640a9-d986-469a-96cc-1d703e501fe4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:25.168767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-888640a9-d986-469a-96cc-1d703e501fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:25.177683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1142/2290] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:21:25.182439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8b93-9f79-4c63-94e1-de8365fc848f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.191934 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8b93-9f79-4c63-94e1-de8365fc848f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.196457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.197683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.197966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.198245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.198965 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:21:25.199274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.200867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.212729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1149/2291] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:21:25.216801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888640a9-d986-469a-96cc-1d703e501fe4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.225926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888640a9-d986-469a-96cc-1d703e501fe4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.230585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.231245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.231509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.231780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.232468 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.234405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.260273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1143/2292] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:21:25 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:21:25.264234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.274150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb876d4-fd6c-491d-beff-e393ea78a8ec admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.323988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:25.330320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.330984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.331274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.331550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.332514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.334510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.354473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1150/2293] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:21:25 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:21:25.358514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.368636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936c063-7a8f-4c4b-85ec-04ad3cea9fbc admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.373814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.374463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.374745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.375017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.375738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.377317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.388153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1144/2294] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:21:25.391770 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.401768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5353dbb-0c1a-4173-847e-ee7368a09c34 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.406408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2ab4e-fda7-47e3-a4d2-fa9b1a80f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.407057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ab4e-fda7-47e3-a4d2-fa9b1a80f9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.407338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ab4e-fda7-47e3-a4d2-fa9b1a80f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.407608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ab4e-fda7-47e3-a4d2-fa9b1a80f9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.408358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ab4e-fda7-47e3-a4d2-fa9b1a80f9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.410257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ab4e-fda7-47e3-a4d2-fa9b1a80f9a8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.422766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1151/2295] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:25.426975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.438916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346399-7910-4d1c-b6b8-87d54f1bd05c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.443607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.444492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.444773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.445049 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] PATH_INFO: `/v3/projects/3fd4d210e5bc4e4dabc198bc068b29ab/users/b849c494e8bb4936a704a97d123a1752/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.460601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd4d210e5bc4e4dabc198bc068b29ab, user_id=b849c494e8bb4936a704a97d123a1752, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.463347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.479185 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1145/2296] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:25 2022] PUT /identity/v3/projects/3fd4d210e5bc4e4dabc198bc068b29ab/users/b849c494e8bb4936a704a97d123a1752/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:21:25.489264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4363f4-1e4b-49f4-84e4-d2ce513df9b5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.489796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4363f4-1e4b-49f4-84e4-d2ce513df9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.490101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4363f4-1e4b-49f4-84e4-d2ce513df9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.517721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2b4363f4-1e4b-49f4-84e4-d2ce513df9b5 None None] MFA Rules not processed for user `b849c494e8bb4936a704a97d123a1752`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:25.518859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b4363f4-1e4b-49f4-84e4-d2ce513df9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:25.584883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1152/2297] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:25.596055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.597762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:25.612654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:25.657902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210726-6f28-469e-8b65-521b37244d0b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.661619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee4bad-71fa-4223-ab8c-cdb4e25ce1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.662268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4bad-71fa-4223-ab8c-cdb4e25ce1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.662551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4bad-71fa-4223-ab8c-cdb4e25ce1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.662826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4bad-71fa-4223-ab8c-cdb4e25ce1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.672008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee4bad-71fa-4223-ab8c-cdb4e25ce1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.673426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee4bad-71fa-4223-ab8c-cdb4e25ce1d9 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.683127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1146/2298] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:25.706989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4363f4-1e4b-49f4-84e4-d2ce513df9b5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.777490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4363f4-1e4b-49f4-84e4-d2ce513df9b5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:25.782300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:25.783167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.783452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.783762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] PATH_INFO: `/v3/users/b849c494e8bb4936a704a97d123a1752` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.785005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b849c494e8bb4936a704a97d123a1752)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:25.786902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:25.843418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b849c494e8bb4936a704a97d123a1752'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.844160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b849c494e8bb4936a704a97d123a1752'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.868841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b849c494e8bb4936a704a97d123a1752'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.882228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:25.884833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b849c494e8bb4936a704a97d123a1752'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.885574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b849c494e8bb4936a704a97d123a1752'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:25.903403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1153/2299] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:21:25 2022] DELETE /identity/v3/users/b849c494e8bb4936a704a97d123a1752 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:25.908198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:25.908651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:25.909030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:25.927204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:25.928509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:25.987655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1147/2300] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:21:25.997199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:25.998716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:26.054932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b4774-8c00-4928-a8ef-3513b0262c31 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.058538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554f935-33e5-4329-8bad-75db0b39bafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.059173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f935-33e5-4329-8bad-75db0b39bafa service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.059455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f935-33e5-4329-8bad-75db0b39bafa service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.059729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f935-33e5-4329-8bad-75db0b39bafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.068883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554f935-33e5-4329-8bad-75db0b39bafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.070336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554f935-33e5-4329-8bad-75db0b39bafa service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.081757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1154/2301] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:26.359494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:26.361010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:26.373162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b3856-99d9-48a1-b9d2-61ef00db6842 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.377730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.378590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.378897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.379145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] PATH_INFO: `/v3/projects/3fd4d210e5bc4e4dabc198bc068b29ab` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.380311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd4d210e5bc4e4dabc198bc068b29ab)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.382294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.428350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd4d210e5bc4e4dabc198bc068b29ab', 'request_id': 'req-184c4d93-81dc-4012-8af4-0ff61e02f261'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:26.434533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd4d210e5bc4e4dabc198bc068b29ab', 'request_id': 'req-184c4d93-81dc-4012-8af4-0ff61e02f261'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:26.440951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd4d210e5bc4e4dabc198bc068b29ab', 'request_id': 'req-184c4d93-81dc-4012-8af4-0ff61e02f261'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:26.451647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] The token cache is being invalidate because project 3fd4d210e5bc4e4dabc198bc068b29ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:21:26.451930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:26.452550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-184c4d93-81dc-4012-8af4-0ff61e02f261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:26.454108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1148/2302] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:21:26 2022] DELETE /identity/v3/projects/3fd4d210e5bc4e4dabc198bc068b29ab => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:26.459478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c94d9-7079-45bd-bd5f-1ded5c02614b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.459919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c94d9-7079-45bd-bd5f-1ded5c02614b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.460057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c94d9-7079-45bd-bd5f-1ded5c02614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.477859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8f7c94d9-7079-45bd-bd5f-1ded5c02614b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:26.479071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8f7c94d9-7079-45bd-bd5f-1ded5c02614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:26.536956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1155/2303] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:21:26.544634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e544-2c8b-49ef-b04a-c839ee476680 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.544916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e544-2c8b-49ef-b04a-c839ee476680 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.545201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e544-2c8b-49ef-b04a-c839ee476680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.563525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f2b6e544-2c8b-49ef-b04a-c839ee476680 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:26.564723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f2b6e544-2c8b-49ef-b04a-c839ee476680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:26.573061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1149/2304] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:26.577091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c94d9-7079-45bd-bd5f-1ded5c02614b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:26.586910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c94d9-7079-45bd-bd5f-1ded5c02614b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.591563 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.592212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.592492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.592760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.593530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:21:26.593835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.595406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.607243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1156/2305] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:21:26.611623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e544-2c8b-49ef-b04a-c839ee476680 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:26.621526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e544-2c8b-49ef-b04a-c839ee476680 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.626312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.626996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.627275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.627546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.628240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.630212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.661935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1150/2306] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:21:26 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:26.667484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:26.678553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17f32a-bb4d-48b0-bd9b-8e6e3a0153ce admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.767143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.768231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.768519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.768800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.769723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.771845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.809191 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1157/2307] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:21:26 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:21:26.811807 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:26.826384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949895-9899-4fb6-b139-594826c241a6 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.831262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.831983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.832527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.832806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.833725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.835652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.843459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:26.851150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1151/2308] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:21:26.853912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:26.861963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:26.866148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3529ff6-019a-4f2c-8d9b-45b409000c09 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.875904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76efb43-fd02-4d82-8591-92973c916e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.876778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76efb43-fd02-4d82-8591-92973c916e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.877239 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76efb43-fd02-4d82-8591-92973c916e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.877914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76efb43-fd02-4d82-8591-92973c916e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.878860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76efb43-fd02-4d82-8591-92973c916e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.880730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76efb43-fd02-4d82-8591-92973c916e8a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.895756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1158/2309] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:26.899877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:26.911869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd617b2a-f535-42f8-9f74-3c9ce27773ad admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:26.918100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:26.919605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.919918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.920202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] PATH_INFO: `/v3/projects/9a8b3496188644509f3c31a2eeb08ccf/users/9efb5c9b6f3443a4875cb904a867ef9e/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:26.947836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8b3496188644509f3c31a2eeb08ccf, user_id=9efb5c9b6f3443a4875cb904a867ef9e, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:26.951131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:26.979089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1152/2310] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:26 2022] PUT /identity/v3/projects/9a8b3496188644509f3c31a2eeb08ccf/users/9efb5c9b6f3443a4875cb904a867ef9e/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:26.982423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61351a1e-3da3-47be-9831-324a95264193 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:26.982909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61351a1e-3da3-47be-9831-324a95264193 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:26.983333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61351a1e-3da3-47be-9831-324a95264193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:27.027169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-61351a1e-3da3-47be-9831-324a95264193 None None] MFA Rules not processed for user `9efb5c9b6f3443a4875cb904a867ef9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:27.028444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-61351a1e-3da3-47be-9831-324a95264193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:27.095229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1159/2311] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:27.106859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:27.109085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:27.170910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccbead-c282-405d-9b85-00e91336e845 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:27.175208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37307c-b6ad-4dd5-86b7-d6040d266055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:27.175851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37307c-b6ad-4dd5-86b7-d6040d266055 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:27.176130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37307c-b6ad-4dd5-86b7-d6040d266055 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:27.176406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37307c-b6ad-4dd5-86b7-d6040d266055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:27.185382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37307c-b6ad-4dd5-86b7-d6040d266055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:27.186857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37307c-b6ad-4dd5-86b7-d6040d266055 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:27.195711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1153/2312] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:29.191307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61351a1e-3da3-47be-9831-324a95264193 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:29.192743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-61351a1e-3da3-47be-9831-324a95264193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:29.264648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61351a1e-3da3-47be-9831-324a95264193 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:29.264648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:29.264648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:29.264909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:29.265181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] PATH_INFO: `/v3/users/614bf937b5f8402bb6afdd7d71ac24a4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:29.266678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=614bf937b5f8402bb6afdd7d71ac24a4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:29.268781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:29.329735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614bf937b5f8402bb6afdd7d71ac24a4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.331540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614bf937b5f8402bb6afdd7d71ac24a4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.346452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614bf937b5f8402bb6afdd7d71ac24a4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.367711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614bf937b5f8402bb6afdd7d71ac24a4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.368416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614bf937b5f8402bb6afdd7d71ac24a4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.380431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1160/2313] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:21:29 2022] DELETE /identity/v3/users/614bf937b5f8402bb6afdd7d71ac24a4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:29.385587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:29.386064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:29.386172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:29.403575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:29.404768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:29.475816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1154/2314] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:29.485869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:29.487513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:29.493543 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:29.574381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207922-4cae-4205-b478-b6542c879adb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:29.579373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:29.580043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:29.580313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:29.580589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:29.591236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:29.592677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:29.604271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1161/2315] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:29.876220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:29.877828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:29.892763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd626d9-7305-48a1-b747-2fad98d27a34 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:29.897328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:29.898222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:29.898507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:29.898783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] PATH_INFO: `/v3/projects/7c44f7254ae946b68df05f9187ebf5dc` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:29.899975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c44f7254ae946b68df05f9187ebf5dc)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:29.901911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:29.952270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c44f7254ae946b68df05f9187ebf5dc', 'request_id': 'req-d68fd6f4-36ac-4c05-959c-242120b0f90a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.959564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c44f7254ae946b68df05f9187ebf5dc', 'request_id': 'req-d68fd6f4-36ac-4c05-959c-242120b0f90a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.977500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c44f7254ae946b68df05f9187ebf5dc', 'request_id': 'req-d68fd6f4-36ac-4c05-959c-242120b0f90a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.991026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] The token cache is being invalidate because project 7c44f7254ae946b68df05f9187ebf5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:21:29.991405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.993374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-d68fd6f4-36ac-4c05-959c-242120b0f90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:29.996062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1155/2316] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:21:29 2022] DELETE /identity/v3/projects/7c44f7254ae946b68df05f9187ebf5dc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:37.010945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:37.012334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:37.025353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5fb8-637a-454e-9349-58b3a2e52c1c service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:37.079523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:37.080386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.080668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.080943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] PATH_INFO: `/v3/users/9efb5c9b6f3443a4875cb904a867ef9e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.082388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efb5c9b6f3443a4875cb904a867ef9e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:37.084340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:37.132804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efb5c9b6f3443a4875cb904a867ef9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.133366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efb5c9b6f3443a4875cb904a867ef9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.141172 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efb5c9b6f3443a4875cb904a867ef9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.154248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efb5c9b6f3443a4875cb904a867ef9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.155118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efb5c9b6f3443a4875cb904a867ef9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.167982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1162/2317] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:21:37 2022] DELETE /identity/v3/users/9efb5c9b6f3443a4875cb904a867ef9e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:37.172717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.173202 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.176945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.182860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:37.196654 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:37.197907 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:37.259737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1156/2318] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:37.269514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:37.270919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:37.298891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:37.328755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946c0e0-c86e-4451-b3b6-98cfa19a66d6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:37.332635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca621ae1-f8ea-4b86-9009-a966cf8fa8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:37.333275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca621ae1-f8ea-4b86-9009-a966cf8fa8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.333587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca621ae1-f8ea-4b86-9009-a966cf8fa8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.333863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca621ae1-f8ea-4b86-9009-a966cf8fa8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.343704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca621ae1-f8ea-4b86-9009-a966cf8fa8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:37.345130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca621ae1-f8ea-4b86-9009-a966cf8fa8a6 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:37.355506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1163/2319] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:37.625806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:37.628766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:37.646835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0592bcd-acd3-4ed3-ba21-6a7d492d1cae None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:37.652104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:37.652970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.653255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.653570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] PATH_INFO: `/v3/projects/9a8b3496188644509f3c31a2eeb08ccf` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.661898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8b3496188644509f3c31a2eeb08ccf)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:37.663808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:37.716204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8b3496188644509f3c31a2eeb08ccf', 'request_id': 'req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.722705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8b3496188644509f3c31a2eeb08ccf', 'request_id': 'req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.730177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8b3496188644509f3c31a2eeb08ccf', 'request_id': 'req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.740950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] The token cache is being invalidate because project 9a8b3496188644509f3c31a2eeb08ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:21:37.741297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.742130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-010728f4-3183-4a0c-b8e4-a0c4ccc40e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:37.743731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1157/2320] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:21:37 2022] DELETE /identity/v3/projects/9a8b3496188644509f3c31a2eeb08ccf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:37.748655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dd8c-9c36-4962-8ed5-b0305f227f65 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.748951 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dd8c-9c36-4962-8ed5-b0305f227f65 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.749222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dd8c-9c36-4962-8ed5-b0305f227f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.777786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e7e6dd8c-9c36-4962-8ed5-b0305f227f65 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:37.779002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e7e6dd8c-9c36-4962-8ed5-b0305f227f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:37.842103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1164/2321] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:37.849918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f32db-3449-450f-b73d-07584876509a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.850208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f32db-3449-450f-b73d-07584876509a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.850485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f32db-3449-450f-b73d-07584876509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.868288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-e20f32db-3449-450f-b73d-07584876509a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:37.870019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e20f32db-3449-450f-b73d-07584876509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:37.877758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1158/2322] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:37.881668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6dd8c-9c36-4962-8ed5-b0305f227f65 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:37.894664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6dd8c-9c36-4962-8ed5-b0305f227f65 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:37.903197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:37.904152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.904749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.904749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.905434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:21:37.905801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:37.907409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:37.921686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1165/2323] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:21:37.925913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f32db-3449-450f-b73d-07584876509a None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:37.936617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f32db-3449-450f-b73d-07584876509a None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:37.942483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:37.943214 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:37.943566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:37.943999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:37.944711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:37.947438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:37.980159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1159/2324] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:21:37 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:37.984269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:37.995008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c85c8-c422-4a2e-a2da-7967ebb9c9d6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:38.059524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:38.060187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:38.060459 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:38.060733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:38.061412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:38.063371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:38.083465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1166/2325] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:21:37 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:38.087603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:38.097923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294f8d-800a-4db5-9d03-efdf9dc479fd admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:38.102497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:38.103152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:38.103433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:38.103732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:38.104448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:38.106095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:38.116492 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1160/2326] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:38.120674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:38.131003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39df5-5649-4291-b687-af9cebace14f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:38.136194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5146a4-74a3-4c1a-9b72-043e4f36f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:38.136845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5146a4-74a3-4c1a-9b72-043e4f36f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:38.137131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5146a4-74a3-4c1a-9b72-043e4f36f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:38.137409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5146a4-74a3-4c1a-9b72-043e4f36f1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:38.138164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5146a4-74a3-4c1a-9b72-043e4f36f1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:38.139741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5146a4-74a3-4c1a-9b72-043e4f36f1d7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:38.149384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1167/2327] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:38.153181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:38.162980 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359667b2-6bd1-4159-8f13-98f1c03432e7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:38.168027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:38.168892 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:38.169172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:38.169444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] PATH_INFO: `/v3/projects/a6288f163e6a46c1ae3a4517c0f207c5/users/02b5d30e956f46898764c6a7b6a00a3c/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:38.185865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6288f163e6a46c1ae3a4517c0f207c5, user_id=02b5d30e956f46898764c6a7b6a00a3c, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:38.188524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:38.201945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1161/2328] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:38 2022] PUT /identity/v3/projects/a6288f163e6a46c1ae3a4517c0f207c5/users/02b5d30e956f46898764c6a7b6a00a3c/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:38.213243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40917783-573b-4e6e-81bd-2774d081c02d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:38.213655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40917783-573b-4e6e-81bd-2774d081c02d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:38.213940 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40917783-573b-4e6e-81bd-2774d081c02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:38.240341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-40917783-573b-4e6e-81bd-2774d081c02d None None] MFA Rules not processed for user `02b5d30e956f46898764c6a7b6a00a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:38.241571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-40917783-573b-4e6e-81bd-2774d081c02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:38.254906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:38.309551 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1168/2329] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:38.320857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:38.323108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:38.353297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:38.403639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f553e9-80e8-4bb8-b447-ea2dfdad4ba4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:38.408417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:38.409070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:38.409353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:38.409667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:38.419009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:38.420401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:38.430677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1162/2330] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:40.335962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a279-e55c-41d2-9547-e656497ba0f8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:40.336477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a279-e55c-41d2-9547-e656497ba0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:40.336651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a279-e55c-41d2-9547-e656497ba0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:40.365131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9783a279-e55c-41d2-9547-e656497ba0f8 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:40.366376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9783a279-e55c-41d2-9547-e656497ba0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:40.426513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1169/2331] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:21:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:40.466821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:40.468235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:40.548276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b417c-dd13-4ba7-8945-44f114c33a5d service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:40.554292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:40.554972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:40.555253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:40.555555 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:40.565945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:40.570674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:40.588665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1163/2332] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:21:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:21:41.214527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbb7aa-619e-473f-bd1a-fffaedfe8a47 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:41.214818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbb7aa-619e-473f-bd1a-fffaedfe8a47 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:41.215227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbb7aa-619e-473f-bd1a-fffaedfe8a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:41.238716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b3fbb7aa-619e-473f-bd1a-fffaedfe8a47 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:41.240015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b3fbb7aa-619e-473f-bd1a-fffaedfe8a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:41.247848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1170/2333] 10.222.0.47 () {58 vars in 967 bytes} [Thu Jun 30 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:41.262040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:41.278753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14f289-55cd-421d-9c11-ff3111bb3cff service swift] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:41.284646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:41.285298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:41.285617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:41.285902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:41.294898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:41.296468 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:41.305384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1164/2334] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:21:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:21:41.551030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ab62-6400-45eb-9815-52170f3b5bc4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:41.551865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ab62-6400-45eb-9815-52170f3b5bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:41.552307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ab62-6400-45eb-9815-52170f3b5bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:41.574708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-da82ab62-6400-45eb-9815-52170f3b5bc4 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:41.576061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-da82ab62-6400-45eb-9815-52170f3b5bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:41.584325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1171/2335] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:41.596393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:41.606931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391a48a-cb0d-4ed3-a179-7861aba93b38 service swift] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:41.612176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:41.612822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:41.613108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:41.613383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:41.623385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:41.625038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:41.633741 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1165/2336] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:21:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:21:41.994532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193f87-5fef-4312-afd2-5cb62a2e4741 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:41.994824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193f87-5fef-4312-afd2-5cb62a2e4741 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:41.995100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193f87-5fef-4312-afd2-5cb62a2e4741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.013265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1b193f87-5fef-4312-afd2-5cb62a2e4741 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:42.014532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1b193f87-5fef-4312-afd2-5cb62a2e4741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:42.021945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1172/2337] 10.222.0.47 () {58 vars in 967 bytes} [Thu Jun 30 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:42.035188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:42.046874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbed10-1a1e-4166-84f8-378be046c3d2 service swift] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:42.052174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e0705-d505-4e79-96f9-cf5c6f672205 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:42.052826 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e0705-d505-4e79-96f9-cf5c6f672205 service swift] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.053112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e0705-d505-4e79-96f9-cf5c6f672205 service swift] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.053391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e0705-d505-4e79-96f9-cf5c6f672205 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.062631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e0705-d505-4e79-96f9-cf5c6f672205 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:42.064287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e0705-d505-4e79-96f9-cf5c6f672205 service swift] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:42.073598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1166/2338] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:21:42.086964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1bad-da48-4f99-9bc3-b2c65ef30e27 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.087360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1bad-da48-4f99-9bc3-b2c65ef30e27 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.087823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1bad-da48-4f99-9bc3-b2c65ef30e27 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.089752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1173/2339] 10.222.0.47 () {54 vars in 921 bytes} [Thu Jun 30 13:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 13:21:42.118109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9441-2667-4d11-857a-cc296ca2350c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.119315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9441-2667-4d11-857a-cc296ca2350c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.119672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9441-2667-4d11-857a-cc296ca2350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.187434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-faee9441-2667-4d11-857a-cc296ca2350c None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:42.188873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-faee9441-2667-4d11-857a-cc296ca2350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:42.204036 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1bad-da48-4f99-9bc3-b2c65ef30e27 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:42.206245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46cd1bad-da48-4f99-9bc3-b2c65ef30e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:42.264693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:42.301087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1167/2340] 10.222.0.47 () {58 vars in 1018 bytes} [Thu Jun 30 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:42.302745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.303098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.303447 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.314929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1bad-da48-4f99-9bc3-b2c65ef30e27 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:42.320332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:42.322036 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.322507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.322789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] PATH_INFO: `/v3/users/412740aac1bf451c8c92808b42a1c318` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.324030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412740aac1bf451c8c92808b42a1c318)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:42.326047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:42.327327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] MFA Rules not processed for user `640e3ad3e6174e8e86333ae5c1a907ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:42.328675 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:42.367841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:42.384844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412740aac1bf451c8c92808b42a1c318'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.384844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412740aac1bf451c8c92808b42a1c318'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.395272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412740aac1bf451c8c92808b42a1c318'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.403601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1168/2341] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:42.404498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:42.406191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:42.423914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c42635-414b-4b24-aa2f-b5a67b3e3865 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:42.437098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412740aac1bf451c8c92808b42a1c318'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.439176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412740aac1bf451c8c92808b42a1c318'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.439453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccc9b0-cf64-4dc5-b44c-ad62f11ba630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:42.440122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc9b0-cf64-4dc5-b44c-ad62f11ba630 service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.440413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc9b0-cf64-4dc5-b44c-ad62f11ba630 service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.440693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc9b0-cf64-4dc5-b44c-ad62f11ba630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.442850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5cccc9b0-cf64-4dc5-b44c-ad62f11ba630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:42.459370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccc9b0-cf64-4dc5-b44c-ad62f11ba630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:42.460806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccc9b0-cf64-4dc5-b44c-ad62f11ba630 service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:42.469478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1174/2342] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:21:42 2022] DELETE /identity/v3/users/412740aac1bf451c8c92808b42a1c318 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:21:42.485992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1169/2343] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:42.674476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:42.676055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:42.773413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b40582-a8c2-4cfb-9471-e08113c45204 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:42.782604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:42.783545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.784041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.784375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] PATH_INFO: `/v3/projects/d6c4fb1654464eaab9c87641df5951cc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.785708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c4fb1654464eaab9c87641df5951cc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:42.787720 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:42.851293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c4fb1654464eaab9c87641df5951cc', 'request_id': 'req-c27785bd-2d47-46eb-a17b-fceefb5017e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.861874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c4fb1654464eaab9c87641df5951cc', 'request_id': 'req-c27785bd-2d47-46eb-a17b-fceefb5017e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.870182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c4fb1654464eaab9c87641df5951cc', 'request_id': 'req-c27785bd-2d47-46eb-a17b-fceefb5017e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.882024 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] The token cache is being invalidate because project d6c4fb1654464eaab9c87641df5951cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:21:42.882403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.883890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c27785bd-2d47-46eb-a17b-fceefb5017e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:42.885593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1175/2344] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:21:42 2022] DELETE /identity/v3/projects/d6c4fb1654464eaab9c87641df5951cc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:42.891956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109472b-977f-4712-8462-44401862bbc8 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:42.892473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109472b-977f-4712-8462-44401862bbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:42.892568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109472b-977f-4712-8462-44401862bbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:42.921885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b109472b-977f-4712-8462-44401862bbc8 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:42.923128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b109472b-977f-4712-8462-44401862bbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:43.000929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1170/2345] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:43.008794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627a62-80dc-43be-b1dd-8591f8da4a5b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.009145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627a62-80dc-43be-b1dd-8591f8da4a5b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.009426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627a62-80dc-43be-b1dd-8591f8da4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.029370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a0627a62-80dc-43be-b1dd-8591f8da4a5b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:43.030780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a0627a62-80dc-43be-b1dd-8591f8da4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:43.039404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1176/2346] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:43.044154 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109472b-977f-4712-8462-44401862bbc8 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:43.054347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109472b-977f-4712-8462-44401862bbc8 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:43.059320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:43.060087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.060432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.060765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.061608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:21:43.062165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:43.064168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:43.077505 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1171/2347] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:21:43.082259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0627a62-80dc-43be-b1dd-8591f8da4a5b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:43.093439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0627a62-80dc-43be-b1dd-8591f8da4a5b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:43.098409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:43.099094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.099362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.099639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.100348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:43.102432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:43.133284 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1177/2348] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:21:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:21:43.138123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:43.154129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14610f1-b454-4329-95b5-71f31ecfe85c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:43.241527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:43.250082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:43.251119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.251594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.252451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.253528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:43.255223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:43.281546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1172/2349] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:21:43 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:43.286057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:43.300022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b105cd-7abe-429e-a3c8-e6efb8da03b0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:43.305693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:43.306552 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.307042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.307519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.308441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:43.310642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:43.317616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:43.325544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1178/2350] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:43.328298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:43.340303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49ab8-332c-4a09-a51e-da626f03e94a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:43.345651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b7d90-cf4b-4e67-819a-9bedbb1d49f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:43.346527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7d90-cf4b-4e67-819a-9bedbb1d49f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.346930 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7d90-cf4b-4e67-819a-9bedbb1d49f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.347331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7d90-cf4b-4e67-819a-9bedbb1d49f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.348268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b7d90-cf4b-4e67-819a-9bedbb1d49f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:43.350913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b7d90-cf4b-4e67-819a-9bedbb1d49f9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:43.362877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1173/2351] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:43.366905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:43.376894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1774e-8d12-4ba6-9704-1399c9c7305e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:43.381789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:43.382665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.382949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.383227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] PATH_INFO: `/v3/projects/04fff247cc8c44aabff5b7af0c426cea/users/51c5581067e2491780f2d04a598960ea/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.398848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fff247cc8c44aabff5b7af0c426cea, user_id=51c5581067e2491780f2d04a598960ea, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:43.402220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:43.415870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1179/2352] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:43 2022] PUT /identity/v3/projects/04fff247cc8c44aabff5b7af0c426cea/users/51c5581067e2491780f2d04a598960ea/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:43.421102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.421667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.421954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.440913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:43.442152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:43.505910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1174/2353] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:43.516813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:43.518607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:43.580685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b935e-e453-4ec2-8d84-3ddff3c39c82 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:43.584590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05143-197c-4d9e-948e-700a1497b663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:43.585885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05143-197c-4d9e-948e-700a1497b663 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:43.586230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05143-197c-4d9e-948e-700a1497b663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:43.586620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05143-197c-4d9e-948e-700a1497b663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:43.596034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05143-197c-4d9e-948e-700a1497b663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:43.597400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05143-197c-4d9e-948e-700a1497b663 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:43.607472 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1180/2354] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:21:45.433247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:45.434827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:45.449323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1240f5-e40f-48ba-b9bd-752fc820c4d1 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:45.454291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:45.455345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:45.455717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:45.456114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] PATH_INFO: `/v3/users/72820d12d73d48e4b07e5e860f3cee4f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:45.457965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72820d12d73d48e4b07e5e860f3cee4f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:45.460059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:45.532086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72820d12d73d48e4b07e5e860f3cee4f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:45.533870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72820d12d73d48e4b07e5e860f3cee4f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:45.562853 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72820d12d73d48e4b07e5e860f3cee4f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:45.564386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72820d12d73d48e4b07e5e860f3cee4f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:45.575362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72820d12d73d48e4b07e5e860f3cee4f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:45.598643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1175/2355] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:21:45 2022] DELETE /identity/v3/users/72820d12d73d48e4b07e5e860f3cee4f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:45.604918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:45.606091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:45.606474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:45.628996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:45.630433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:45.733673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1181/2356] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:45.744724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:45.747221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:45.819935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:45.827639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6cc21-f5ea-4219-bbe4-9deeecdc70e8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:45.832954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a36e-5112-405b-94f1-57606fded390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:45.833790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a36e-5112-405b-94f1-57606fded390 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:45.834323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a36e-5112-405b-94f1-57606fded390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:45.834849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a36e-5112-405b-94f1-57606fded390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:45.848976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a36e-5112-405b-94f1-57606fded390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:45.850610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a36e-5112-405b-94f1-57606fded390 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:45.862061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1176/2357] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:46.219751 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:46.221874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:46.242355 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb2dd-0967-4f0f-ab5c-fe44d9bd7093 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:46.248484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:46.249786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.250296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.250916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] PATH_INFO: `/v3/projects/45326c5e651a410b8eb85aa1f6faca5a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.252518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45326c5e651a410b8eb85aa1f6faca5a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:46.254682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:46.340078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45326c5e651a410b8eb85aa1f6faca5a', 'request_id': 'req-c0863e3c-1a06-48d0-abcd-7e458458057b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:46.366455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45326c5e651a410b8eb85aa1f6faca5a', 'request_id': 'req-c0863e3c-1a06-48d0-abcd-7e458458057b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:46.378771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45326c5e651a410b8eb85aa1f6faca5a', 'request_id': 'req-c0863e3c-1a06-48d0-abcd-7e458458057b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:46.404175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] The token cache is being invalidate because project 45326c5e651a410b8eb85aa1f6faca5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:21:46.405754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:46.406775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c0863e3c-1a06-48d0-abcd-7e458458057b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:46.409420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1182/2358] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:21:46 2022] DELETE /identity/v3/projects/45326c5e651a410b8eb85aa1f6faca5a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:46.416206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e499-1d34-4ac4-96e6-083b7ad6a8af None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.416206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e499-1d34-4ac4-96e6-083b7ad6a8af None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.416550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e499-1d34-4ac4-96e6-083b7ad6a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.440789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-91f4e499-1d34-4ac4-96e6-083b7ad6a8af None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:46.444426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-91f4e499-1d34-4ac4-96e6-083b7ad6a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:46.547811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1177/2359] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:46.558187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c89c2c-9630-456a-9fb3-42051d7957d4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.559547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c89c2c-9630-456a-9fb3-42051d7957d4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.559685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c89c2c-9630-456a-9fb3-42051d7957d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.573810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:46.606732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-74c89c2c-9630-456a-9fb3-42051d7957d4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:46.608429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-74c89c2c-9630-456a-9fb3-42051d7957d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:46.633988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1183/2360] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:46.635280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4e499-1d34-4ac4-96e6-083b7ad6a8af None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:46.646844 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4e499-1d34-4ac4-96e6-083b7ad6a8af None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:46.656527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:46.657328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.657931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.658308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.659170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:21:46.659655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:46.661775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:46.684774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1178/2361] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:21:46.688895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c89c2c-9630-456a-9fb3-42051d7957d4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:46.704631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c89c2c-9630-456a-9fb3-42051d7957d4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:46.711931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:46.712760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.713138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.713570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.714500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:46.716792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:46.771441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1184/2362] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:21:46 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:46.772678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:46.783267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ba662-adf9-4dd4-9aae-861bce1a56c0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:46.851621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:46.852669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.853731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.854345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.855305 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:46.857631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:46.888954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1179/2363] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:21:46 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:46.892592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:46.904173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e3ef-be7d-4c84-b17b-e23ffe29d19d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:46.916375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:46.917292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.917868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.918739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.919824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:46.921719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:46.935144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1185/2364] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:46.938792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:46.952382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ff6fd-9017-42d4-8f88-989c676fd1c5 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:46.958066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341ff8b-061b-4992-b2e4-1d1197afea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:46.958744 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ff8b-061b-4992-b2e4-1d1197afea00 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:46.959032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ff8b-061b-4992-b2e4-1d1197afea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:46.959309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ff8b-061b-4992-b2e4-1d1197afea00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:46.960054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341ff8b-061b-4992-b2e4-1d1197afea00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:46.961821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341ff8b-061b-4992-b2e4-1d1197afea00 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:46.976297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1180/2365] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:46.981102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:47.002185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ccab7-345f-44fa-9b20-7b7da4f74e69 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:47.009608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:47.011093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:47.011475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:47.011849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] PATH_INFO: `/v3/projects/b663be24dc3f48a3ac9ce0612174118c/users/5d47cf730e0e46f8bd9cd9ef8743125d/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:47.037907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b663be24dc3f48a3ac9ce0612174118c, user_id=5d47cf730e0e46f8bd9cd9ef8743125d, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:47.041158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:47.058227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1186/2366] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:46 2022] PUT /identity/v3/projects/b663be24dc3f48a3ac9ce0612174118c/users/5d47cf730e0e46f8bd9cd9ef8743125d/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:47.062941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:47.063336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:47.063711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:47.083376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:47.084995 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:47.152020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:47.163367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1181/2367] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:21:47.173870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:47.177432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:47.263904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd8725-7f35-4acf-b374-b0b9993a4be3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:47.268270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa72f-337c-4591-8ef3-2bec606c5e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:47.269042 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa72f-337c-4591-8ef3-2bec606c5e3e service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:47.269499 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa72f-337c-4591-8ef3-2bec606c5e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:47.269775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa72f-337c-4591-8ef3-2bec606c5e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:47.283364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa72f-337c-4591-8ef3-2bec606c5e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:47.284811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa72f-337c-4591-8ef3-2bec606c5e3e service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:47.295481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1187/2368] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:47.654736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:47.657818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:47.672205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59e84-c16a-41c0-b95b-782f200d1a37 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:47.677870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:47.679489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:47.679489 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:47.679691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] PATH_INFO: `/v3/users/02b5d30e956f46898764c6a7b6a00a3c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:47.681805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b5d30e956f46898764c6a7b6a00a3c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:47.683958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:47.778078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b5d30e956f46898764c6a7b6a00a3c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:47.779714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b5d30e956f46898764c6a7b6a00a3c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:47.810858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b5d30e956f46898764c6a7b6a00a3c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:47.812978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b5d30e956f46898764c6a7b6a00a3c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:47.831810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b5d30e956f46898764c6a7b6a00a3c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:47.855083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1182/2369] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:21:47 2022] DELETE /identity/v3/users/02b5d30e956f46898764c6a7b6a00a3c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:47.859862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:47.860386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:47.860386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:47.881400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:47.882656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:47.979604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1188/2370] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:48.001504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:48.004441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:48.164877 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1011479-8215-4e1a-8510-1e791ed5b612 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:48.175074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90c1e4-8c2c-4abe-84f6-3d518cccfea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:48.181553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90c1e4-8c2c-4abe-84f6-3d518cccfea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:48.181553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90c1e4-8c2c-4abe-84f6-3d518cccfea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:48.181553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90c1e4-8c2c-4abe-84f6-3d518cccfea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:48.195208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90c1e4-8c2c-4abe-84f6-3d518cccfea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:48.196947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90c1e4-8c2c-4abe-84f6-3d518cccfea2 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:48.216914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1183/2371] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:49.660340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:49.661972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:49.694173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae6154-3f71-4745-8f66-7ec39756fcce None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:49.704732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:49.706091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:49.706371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:49.706648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] PATH_INFO: `/v3/projects/a6288f163e6a46c1ae3a4517c0f207c5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:49.708806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6288f163e6a46c1ae3a4517c0f207c5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:49.710818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:49.833686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:49.848848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6288f163e6a46c1ae3a4517c0f207c5', 'request_id': 'req-0f17eb19-79cc-4018-a0ff-36ed5d026176'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:49.868639 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6288f163e6a46c1ae3a4517c0f207c5', 'request_id': 'req-0f17eb19-79cc-4018-a0ff-36ed5d026176'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:49.878053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6288f163e6a46c1ae3a4517c0f207c5', 'request_id': 'req-0f17eb19-79cc-4018-a0ff-36ed5d026176'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:49.895043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] The token cache is being invalidate because project a6288f163e6a46c1ae3a4517c0f207c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:21:49.895347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:49.896025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:21:49.900557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1189/2372] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:21:49 2022] DELETE /identity/v3/projects/a6288f163e6a46c1ae3a4517c0f207c5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:50.698479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3673cb-05b0-462c-9a11-8a86fb17dbf4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:50.698479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3673cb-05b0-462c-9a11-8a86fb17dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:50.699043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3673cb-05b0-462c-9a11-8a86fb17dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:50.745328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3f3673cb-05b0-462c-9a11-8a86fb17dbf4 None None] MFA Rules not processed for user `51c5581067e2491780f2d04a598960ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:50.746147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3f3673cb-05b0-462c-9a11-8a86fb17dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:50.894896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1184/2373] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:50.898921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:50.901051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:51.003497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17eb19-79cc-4018-a0ff-36ed5d026176 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:51.025238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:51.025980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:51.026269 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:51.026553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:51.027439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:51.029399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:51.108017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1190/2374] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:21:50 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:51.112564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3673cb-05b0-462c-9a11-8a86fb17dbf4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:51.119798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:51.130973 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3673cb-05b0-462c-9a11-8a86fb17dbf4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:51.245608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:51.246261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:51.246655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:51.247030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:51.248521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:51.251298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:51.284773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1185/2375] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:21:51 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:51.285341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:51.303929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e0ed0-0f72-4d66-84de-0aa3c4dd53ba admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:51.309225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:51.310192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:51.310695 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:51.311288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:51.312283 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:51.314658 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:51.334428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1191/2376] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:51.338817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:51.355903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac4e76-9e98-4697-8fb0-315a261959b7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:51.368818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:51.369869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:51.370153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:51.370430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] PATH_INFO: `/v3/projects/aafded08b292492480ef90dbf5ccadfe/users/daad6499c0754e0493e60ce00eb9ed5a/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:51.398117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafded08b292492480ef90dbf5ccadfe, user_id=daad6499c0754e0493e60ce00eb9ed5a, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:51.401898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:51.422834 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1186/2377] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:51 2022] PUT /identity/v3/projects/aafded08b292492480ef90dbf5ccadfe/users/daad6499c0754e0493e60ce00eb9ed5a/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:51.426426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:51.441503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58666-ef78-47b5-b7af-c61f99ad88dc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:51.525312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b49f1-c8bc-42a9-9ef0-cace75f01beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:51.526789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b49f1-c8bc-42a9-9ef0-cace75f01beb admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:51.527304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b49f1-c8bc-42a9-9ef0-cace75f01beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:51.528219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b49f1-c8bc-42a9-9ef0-cace75f01beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:51.530407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b49f1-c8bc-42a9-9ef0-cace75f01beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:51.532868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b49f1-c8bc-42a9-9ef0-cace75f01beb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:51.548356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1192/2378] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:51.552066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:51.563343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c870322-96a2-4635-ac45-16d971449d53 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:51.568315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:51.569107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:51.569389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:51.569873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] PATH_INFO: `/v3/projects/aafded08b292492480ef90dbf5ccadfe/users/daad6499c0754e0493e60ce00eb9ed5a/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:51.572253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafded08b292492480ef90dbf5ccadfe, user_id=daad6499c0754e0493e60ce00eb9ed5a, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:51.575874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:51.602398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1187/2379] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:51 2022] PUT /identity/v3/projects/aafded08b292492480ef90dbf5ccadfe/users/daad6499c0754e0493e60ce00eb9ed5a/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:53.320878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31fce-2005-4f37-8ff0-a03347be4c6a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:53.322511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31fce-2005-4f37-8ff0-a03347be4c6a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:53.322795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31fce-2005-4f37-8ff0-a03347be4c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:53.375427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7de31fce-2005-4f37-8ff0-a03347be4c6a None None] MFA Rules not processed for user `5d47cf730e0e46f8bd9cd9ef8743125d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:53.377037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7de31fce-2005-4f37-8ff0-a03347be4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:53.418897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:53.490599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1193/2380] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:53.495773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:53.498290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:53.621244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99922-a9d0-412c-8328-715687d43535 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:53.642868 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:53.644715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:53.645278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:53.645737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:53.646870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:53.650343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:53.701282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1188/2381] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:21:53 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:53.708565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de31fce-2005-4f37-8ff0-a03347be4c6a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:53.733928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de31fce-2005-4f37-8ff0-a03347be4c6a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:53.809356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:53.810237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:53.810528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:53.810812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:53.811764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:53.814179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:53.845531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1194/2382] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:21:53 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:21:53.851192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:53.887627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e4c45-4ef1-42a0-9d37-e816e913951a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:53.897274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:53.898088 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:53.898376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:53.898713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:53.902955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:53.905326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:53.946098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1189/2383] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:53.946481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:53.960960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec6bb-86dc-46be-a4b8-5c3a52067483 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:53.967984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:53.968996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:53.969440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:53.969862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] PATH_INFO: `/v3/projects/32d9e6d08e304d659d450e852d86c23d/users/77df8062696d4bfabdfed301e55617be/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:54.000006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d9e6d08e304d659d450e852d86c23d, user_id=77df8062696d4bfabdfed301e55617be, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:54.002958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:54.030077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1195/2384] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:53 2022] PUT /identity/v3/projects/32d9e6d08e304d659d450e852d86c23d/users/77df8062696d4bfabdfed301e55617be/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:21:54.034112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:54.050055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4674-e88d-4366-a819-b897164a776f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:54.101138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:54.181357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a670c-e406-44bd-89bb-445404d1e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:54.190540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a670c-e406-44bd-89bb-445404d1e524 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:54.190843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a670c-e406-44bd-89bb-445404d1e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:54.191129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a670c-e406-44bd-89bb-445404d1e524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:54.192163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a670c-e406-44bd-89bb-445404d1e524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:54.194229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a670c-e406-44bd-89bb-445404d1e524 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:54.213070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1190/2385] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:21:54.217028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:54.235231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8070a-1988-4482-b9a4-4cd9e42966a2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:54.242130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:54.244020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:54.245187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:54.245693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] PATH_INFO: `/v3/projects/32d9e6d08e304d659d450e852d86c23d/users/77df8062696d4bfabdfed301e55617be/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:54.254413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d9e6d08e304d659d450e852d86c23d, user_id=77df8062696d4bfabdfed301e55617be, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:54.258257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:54.276661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1196/2386] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:21:54 2022] PUT /identity/v3/projects/32d9e6d08e304d659d450e852d86c23d/users/77df8062696d4bfabdfed301e55617be/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:21:59.476258 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ff2a5-6be5-4682-be76-aa3392218e94 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:59.478418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ff2a5-6be5-4682-be76-aa3392218e94 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:59.481823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ff2a5-6be5-4682-be76-aa3392218e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:59.543246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d73ff2a5-6be5-4682-be76-aa3392218e94 None None] MFA Rules not processed for user `daad6499c0754e0493e60ce00eb9ed5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:21:59.545977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d73ff2a5-6be5-4682-be76-aa3392218e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:59.716486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1191/2387] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:21:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:21:59.724433 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:59.726289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:59.864067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:59.917205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253fbdc-2826-492c-815d-ab0051c6530a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:59.924018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:59.924921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:59.925341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:59.925839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:00.011531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:22:00.014011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:22:00.036324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1197/2388] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:22:00.761317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a132-43dc-4608-b9cd-abe12b0f38dc None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:00.762029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a132-43dc-4608-b9cd-abe12b0f38dc None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:00.762410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a132-43dc-4608-b9cd-abe12b0f38dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:00.801133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-9aa8a132-43dc-4608-b9cd-abe12b0f38dc None None] MFA Rules not processed for user `77df8062696d4bfabdfed301e55617be`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:22:00.802714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-9aa8a132-43dc-4608-b9cd-abe12b0f38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:00.953788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1192/2389] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:22:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:22:00.962905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:22:00.976961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67911b5-920e-4819-ba47-7a624017e269 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:22:00.984237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:22:00.985046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:00.985428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:00.985874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:01.134595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:22:01.156476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:22:01.172187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1198/2390] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:22:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:22:02.605772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf94a60-e76a-44f0-98cf-3a287098e79a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:02.606257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf94a60-e76a-44f0-98cf-3a287098e79a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:02.606375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf94a60-e76a-44f0-98cf-3a287098e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:02.649867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4cf94a60-e76a-44f0-98cf-3a287098e79a None None] MFA Rules not processed for user `51c5581067e2491780f2d04a598960ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:22:02.651261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4cf94a60-e76a-44f0-98cf-3a287098e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:02.669703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1193/2391] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:22:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:22:11.163039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=61 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:12.634903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=87 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:19.180039 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:22:19.181822 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:19.267678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfc2fe-0bbd-4720-8064-93d4bd49a733 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:22:19.272941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ce8db-824b-4bde-beb4-e109399f6618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:22:19.273837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce8db-824b-4bde-beb4-e109399f6618 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:19.274142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce8db-824b-4bde-beb4-e109399f6618 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:19.274463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce8db-824b-4bde-beb4-e109399f6618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:19.276353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-337ce8db-824b-4bde-beb4-e109399f6618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:19.290122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ce8db-824b-4bde-beb4-e109399f6618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:22:19.291712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ce8db-824b-4bde-beb4-e109399f6618 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:22:19.302490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1199/2392] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:22:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:22:22.144663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049aca-6605-4612-9973-9a6f2d355555 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:22.145192 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049aca-6605-4612-9973-9a6f2d355555 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:22.145302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049aca-6605-4612-9973-9a6f2d355555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:22.162975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d2049aca-6605-4612-9973-9a6f2d355555 None None] MFA Rules not processed for user `0281a2bde51542e6af4ad2a23befe12b`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:22:22.164166 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d2049aca-6605-4612-9973-9a6f2d355555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:22.219024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1194/2393] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:22:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:22:29.298652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=32 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:32.211290 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=25 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:38.908909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06c10d-7b93-4069-aa63-50918729a368 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:38.909449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06c10d-7b93-4069-aa63-50918729a368 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:38.909659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06c10d-7b93-4069-aa63-50918729a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:38.926823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bc06c10d-7b93-4069-aa63-50918729a368 None None] MFA Rules not processed for user `5d47cf730e0e46f8bd9cd9ef8743125d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:22:38.928138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bc06c10d-7b93-4069-aa63-50918729a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:38.935032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1200/2394] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:22:47.176001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049aca-6605-4612-9973-9a6f2d355555 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:22:47.244309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049aca-6605-4612-9973-9a6f2d355555 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:22:47.249331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:22:47.250222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:47.250508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:47.250786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] PATH_INFO: `/v3/users/51c5581067e2491780f2d04a598960ea` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:47.251972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c5581067e2491780f2d04a598960ea)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:22:47.253922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:22:47.297419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c5581067e2491780f2d04a598960ea'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.298078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c5581067e2491780f2d04a598960ea'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.309530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c5581067e2491780f2d04a598960ea'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.310151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c5581067e2491780f2d04a598960ea'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.317639 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c5581067e2491780f2d04a598960ea'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.330695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1195/2395] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:22:47 2022] DELETE /identity/v3/users/51c5581067e2491780f2d04a598960ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:22:47.502196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06c10d-7b93-4069-aa63-50918729a368 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:22:47.513256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06c10d-7b93-4069-aa63-50918729a368 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:22:47.570108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:22:47.571015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:47.571297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:47.571572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] PATH_INFO: `/v3/projects/04fff247cc8c44aabff5b7af0c426cea` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:47.572723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fff247cc8c44aabff5b7af0c426cea)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:22:47.574683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:22:47.619923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fff247cc8c44aabff5b7af0c426cea', 'request_id': 'req-0a4bafb5-8f22-4811-ac19-53a114820a90'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.627626 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fff247cc8c44aabff5b7af0c426cea', 'request_id': 'req-0a4bafb5-8f22-4811-ac19-53a114820a90'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.633910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fff247cc8c44aabff5b7af0c426cea', 'request_id': 'req-0a4bafb5-8f22-4811-ac19-53a114820a90'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.644238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] The token cache is being invalidate because project 04fff247cc8c44aabff5b7af0c426cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:22:47.644528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.645175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.647022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1201/2396] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:22:47 2022] DELETE /identity/v3/projects/04fff247cc8c44aabff5b7af0c426cea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:22:47.650978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:22:47.652475 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:47.665442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0184f-d140-423e-8b2d-dea1f994f2a5 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:22:47.721623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:22:47.722504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:47.722786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:47.723063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] PATH_INFO: `/v3/users/daad6499c0754e0493e60ce00eb9ed5a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:47.724246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=daad6499c0754e0493e60ce00eb9ed5a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:22:47.726174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:22:47.749824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:47.775411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daad6499c0754e0493e60ce00eb9ed5a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.776087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daad6499c0754e0493e60ce00eb9ed5a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.788398 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daad6499c0754e0493e60ce00eb9ed5a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.789045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daad6499c0754e0493e60ce00eb9ed5a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.796755 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daad6499c0754e0493e60ce00eb9ed5a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:47.808822 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1196/2397] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:22:47 2022] DELETE /identity/v3/users/daad6499c0754e0493e60ce00eb9ed5a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:22:47.981997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:22:47.984077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:22:47.997099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bafb5-8f22-4811-ac19-53a114820a90 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:22:48.055942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:22:48.056798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:22:48.057077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:22:48.057350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] PATH_INFO: `/v3/projects/aafded08b292492480ef90dbf5ccadfe` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:22:48.058531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafded08b292492480ef90dbf5ccadfe)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:22:48.060407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:22:48.089366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:48.107196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafded08b292492480ef90dbf5ccadfe', 'request_id': 'req-4985d4de-09ea-4106-b7b1-5ca0fcd13745'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:48.114961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafded08b292492480ef90dbf5ccadfe', 'request_id': 'req-4985d4de-09ea-4106-b7b1-5ca0fcd13745'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:48.121224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafded08b292492480ef90dbf5ccadfe', 'request_id': 'req-4985d4de-09ea-4106-b7b1-5ca0fcd13745'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:48.131884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] The token cache is being invalidate because project aafded08b292492480ef90dbf5ccadfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:22:48.132220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:48.132859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:22:48.134443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1202/2398] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:22:47 2022] DELETE /identity/v3/projects/aafded08b292492480ef90dbf5ccadfe => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:22:57.805350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:58.128767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:23:57.083832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:23:57.085245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:23:57.161084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18478da7-5e7e-4081-b372-e72a7c5c7c3b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:23:57.208376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:23:57.209015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:23:57.209294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:23:57.209747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:23:57.211495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:23:57.268058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:23:57.269527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:23:57.278451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1197/2399] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:23:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:23:57.824113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:23:57.825587 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:23:57.838128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985d4de-09ea-4106-b7b1-5ca0fcd13745 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:23:57.841619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:23:57.842248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:23:57.842527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:23:57.842799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:23:57.844483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:23:57.912999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:23:57.914328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:23:57.925217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1203/2400] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:23:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:23:59.448762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:23:59.450248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:23:59.506619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9baba0-0c55-4ae2-9da2-c84a0600d9e5 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:23:59.510152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:23:59.510788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:23:59.511070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:23:59.511347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:23:59.513119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:23:59.522854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:23:59.527266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:23:59.528681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:23:59.539559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1198/2401] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:23:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:24:01.152588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:24:01.161980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7631-2b3d-4b7c-8786-c9b79a311c10 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:24:01.165607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00adfe3-ce3b-4f44-859c-f24c7d3fd205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:24:01.166250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00adfe3-ce3b-4f44-859c-f24c7d3fd205 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:24:01.166534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00adfe3-ce3b-4f44-859c-f24c7d3fd205 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:24:01.166810 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00adfe3-ce3b-4f44-859c-f24c7d3fd205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:24:01.168826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f00adfe3-ce3b-4f44-859c-f24c7d3fd205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:01.262242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00adfe3-ce3b-4f44-859c-f24c7d3fd205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:24:01.263946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00adfe3-ce3b-4f44-859c-f24c7d3fd205 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:24:01.276194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1204/2402] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:24:01.953373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:24:01.955451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:01.970009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91485b5c-790a-46d0-8b2b-edb4803e8d46 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:24:01.976120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:24:01.976762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:24:01.977048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:24:01.977323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:24:01.979165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:02.042617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:24:02.044224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:24:02.053643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1199/2403] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:24:03.931217 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:24:03.931699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:24:03.931794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:24:03.949054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] MFA Rules not processed for user `0281a2bde51542e6af4ad2a23befe12b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:24:03.950280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:03.957270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1205/2404] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:24:04.252538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:24:04.262436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff7fb-f4dc-4710-8c55-9ada6374be96 service nova] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:24:04.266054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:24:04.266694 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:24:04.267109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:24:04.267331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:24:04.269247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:04.280236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:24:04.281756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:24:04.291865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1200/2405] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:24:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:24:04.604457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:24:04.606207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:04.682421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9434de-b81a-4978-a2ef-f79a991e63da None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:24:04.687479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:24:04.688051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:24:04.688339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:24:04.688616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:24:04.690358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:04.701486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:24:04.703058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:24:04.713662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1206/2406] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:24:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:24:14.287727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=37 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:24:14.709642 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:24:16.506495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:24:16.515122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed56d9-fffc-4872-96f1-1743f6f00a9c service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:24:16.518926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:24:16.519559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:24:16.519841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:24:16.520117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:24:16.521918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:24:16.531467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:24:16.532882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:24:16.541316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1201/2407] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:24:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:24:26.538387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=6 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:10.323333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:10.324748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:10.336809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de917-0702-45f7-8423-f14fd84a3a3d service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:10.340312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:10.340948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:10.341230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:10.341535 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:10.343382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:10.402975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:10.404388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:10.413252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1207/2408] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:25:20.409166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=28 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:36.340278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:36.360124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d869549-0891-4120-b3f6-2b9b57c0ece0 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:36.371538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:36.372215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:36.372503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:36.372781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:36.375210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:36.390395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:36.392056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:36.407187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1202/2409] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:25:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:25:46.399236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=6 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:55.130766 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:55.139922 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ae4ef-14b0-4159-850c-141d4b6f1aa0 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:55.143442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:55.144085 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:55.144368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:55.144644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:55.146394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:55.209049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:55.210542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:55.220176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1208/2410] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:25:58.253796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:58.266519 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6c89-af6f-47e6-8ea0-7abe36857a34 service nova] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:58.271524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:58.272159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.272463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.273384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.275243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:58.288752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:58.290702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:58.301830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1203/2411] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:25:58.318526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:58.321630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:58.345484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69156ddf-49a8-466e-990c-5fe54712f8e1 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:58.356173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:58.357064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.357340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.357654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] PATH_INFO: `/v3/users/3ed225bee1dd41a6b5c2c38d785f2d81` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.358847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed225bee1dd41a6b5c2c38d785f2d81)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:58.360787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:58.419470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed225bee1dd41a6b5c2c38d785f2d81'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.420143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed225bee1dd41a6b5c2c38d785f2d81'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.426884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed225bee1dd41a6b5c2c38d785f2d81'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.439807 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed225bee1dd41a6b5c2c38d785f2d81'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.440525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-52249187-ea83-4082-951d-ea113f10deb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed225bee1dd41a6b5c2c38d785f2d81'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.453616 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1209/2412] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:25:58 2022] DELETE /identity/v3/users/3ed225bee1dd41a6b5c2c38d785f2d81 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:25:58.634342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:58.645402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6c946-6fb7-4c24-819d-71a196452031 service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:58.716512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:58.717512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.717873 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.718205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] PATH_INFO: `/v3/projects/52a55063a6304fafb4211384d12bd2a4` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.719498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a55063a6304fafb4211384d12bd2a4)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:58.721577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:58.782677 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a55063a6304fafb4211384d12bd2a4', 'request_id': 'req-79609cb2-c457-4439-9835-732f5773df1e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.788852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a55063a6304fafb4211384d12bd2a4', 'request_id': 'req-79609cb2-c457-4439-9835-732f5773df1e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.796955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a55063a6304fafb4211384d12bd2a4', 'request_id': 'req-79609cb2-c457-4439-9835-732f5773df1e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.807436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] The token cache is being invalidate because project 52a55063a6304fafb4211384d12bd2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:25:58.807723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.808357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-79609cb2-c457-4439-9835-732f5773df1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:25:58.809939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1204/2413] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:25:58 2022] DELETE /identity/v3/projects/52a55063a6304fafb4211384d12bd2a4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:25:58.816569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4bae-c494-4bf8-ae07-e44240262d9c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.816862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4bae-c494-4bf8-ae07-e44240262d9c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.817143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4bae-c494-4bf8-ae07-e44240262d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.836404 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f45c4bae-c494-4bf8-ae07-e44240262d9c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:25:58.837512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f45c4bae-c494-4bf8-ae07-e44240262d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:58.899897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1210/2414] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:25:58.907842 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ef55-d4e3-40ee-b824-6a6b328a6478 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.908131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ef55-d4e3-40ee-b824-6a6b328a6478 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.908408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ef55-d4e3-40ee-b824-6a6b328a6478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.928079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-62b7ef55-d4e3-40ee-b824-6a6b328a6478 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:25:58.929935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-62b7ef55-d4e3-40ee-b824-6a6b328a6478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:58.938144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1205/2415] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:25:58.942478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4bae-c494-4bf8-ae07-e44240262d9c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:58.953369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4bae-c494-4bf8-ae07-e44240262d9c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:58.958356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:58.959005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.959291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.959567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.960901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:25:58.961215 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:58.962857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:58.964438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:58.980013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1211/2416] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:25:58.981566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7ef55-d4e3-40ee-b824-6a6b328a6478 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:58.990837 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7ef55-d4e3-40ee-b824-6a6b328a6478 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:58.995485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:58.996138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.996418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.996687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.997371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:58.999287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.036076 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1206/2417] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:25:58 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:25:59.040253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.050590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d22d-2c69-45ea-b56a-c1e78a564853 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.107748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.108423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.108713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.108994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.109723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.111651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.142090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1212/2418] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:25:59 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:25:59.145986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.156510 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256307-a633-42d7-a67b-97ec5742fee7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.161085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.161782 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.162075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.162347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.163099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.164702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.175029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1207/2419] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:25:59.179670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.189719 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded122ae-36d0-403c-a0e7-600f0905d7f5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.195581 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e943f-4e37-4451-ac51-8bfcdf469d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.196473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e943f-4e37-4451-ac51-8bfcdf469d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.196782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e943f-4e37-4451-ac51-8bfcdf469d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.197134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e943f-4e37-4451-ac51-8bfcdf469d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.197972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e943f-4e37-4451-ac51-8bfcdf469d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.199570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e943f-4e37-4451-ac51-8bfcdf469d26 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.209976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1213/2420] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:25:59.214808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.226262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db506d-a16a-4aee-bd4e-a57240d2a969 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.231040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.231925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.232209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.232485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] PATH_INFO: `/v3/projects/ccfa7817ae63473481ae2a9969f2c269/users/d5125e3617a0486da105d0685ace9363/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.247000 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfa7817ae63473481ae2a9969f2c269, user_id=d5125e3617a0486da105d0685ace9363, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.249665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.263538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1208/2421] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:25:59 2022] PUT /identity/v3/projects/ccfa7817ae63473481ae2a9969f2c269/users/d5125e3617a0486da105d0685ace9363/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:25:59.274280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5f79-8e93-4050-8336-b1332263c06e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.274573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5f79-8e93-4050-8336-b1332263c06e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.274853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5f79-8e93-4050-8336-b1332263c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.300949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7bfa5f79-8e93-4050-8336-b1332263c06e None None] MFA Rules not processed for user `d5125e3617a0486da105d0685ace9363`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:25:59.302190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7bfa5f79-8e93-4050-8336-b1332263c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:59.365974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1214/2422] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:25:59.370425 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.376019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:59.432841 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae6332-7e7e-4056-a0ba-a80d6b826232 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.437395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.438074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.438360 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.438640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.439333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.441220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.466757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1209/2423] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:25:59 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:25:59.470555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa5f79-8e93-4050-8336-b1332263c06e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.480963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa5f79-8e93-4050-8336-b1332263c06e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.536592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.537248 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.537566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.537843 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.538604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.540495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.547802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:59.559522 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1215/2424] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:25:59 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:25:59.563588 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.574150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23df89e-055f-438b-ac0e-844fa5cdeb32 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.578695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.579344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.579623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.579895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.580609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.582507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.593394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1210/2425] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:25:59.597436 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.607833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578aaa-6954-4804-83cf-e21f439c120a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.612324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.613185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.613485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.613765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] PATH_INFO: `/v3/projects/a663ccbadce04814814ed6b915cbf7f1/users/db8aa59e3964471f9660ffdc0f7fe79b/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.628118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663ccbadce04814814ed6b915cbf7f1, user_id=db8aa59e3964471f9660ffdc0f7fe79b, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.630773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.649832 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1216/2426] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:25:59 2022] PUT /identity/v3/projects/a663ccbadce04814814ed6b915cbf7f1/users/db8aa59e3964471f9660ffdc0f7fe79b/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:25:59.653917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.663902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cf7b4-7eea-4b70-8673-5054d54146c8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.721118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a175eb1-d682-4ff5-b674-fe4447cce44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.721817 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a175eb1-d682-4ff5-b674-fe4447cce44b admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.722224 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a175eb1-d682-4ff5-b674-fe4447cce44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.722512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a175eb1-d682-4ff5-b674-fe4447cce44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.723243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a175eb1-d682-4ff5-b674-fe4447cce44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.724854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a175eb1-d682-4ff5-b674-fe4447cce44b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.735549 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1211/2427] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:25:59.740048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.752840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c6e1-b7f2-42b5-ad59-864e7b70a6bf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.758124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.759008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.759319 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.759596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] PATH_INFO: `/v3/projects/a663ccbadce04814814ed6b915cbf7f1/users/db8aa59e3964471f9660ffdc0f7fe79b/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.761617 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663ccbadce04814814ed6b915cbf7f1, user_id=db8aa59e3964471f9660ffdc0f7fe79b, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.764237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.774884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1217/2428] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:25:59 2022] PUT /identity/v3/projects/a663ccbadce04814814ed6b915cbf7f1/users/db8aa59e3964471f9660ffdc0f7fe79b/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:25:59.787260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e531c-3499-43dd-bb2a-84bac443ea4c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.787650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e531c-3499-43dd-bb2a-84bac443ea4c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.788125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e531c-3499-43dd-bb2a-84bac443ea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.815953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a65e531c-3499-43dd-bb2a-84bac443ea4c None None] MFA Rules not processed for user `db8aa59e3964471f9660ffdc0f7fe79b`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:25:59.817201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a65e531c-3499-43dd-bb2a-84bac443ea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:59.883204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:59.889605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1212/2429] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:25:59.899689 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:59.901450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:59.958156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43f7d-f027-4a86-ad3b-dc6d5827e6d1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:59.961772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:59.962408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:59.962693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:59.962973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:59.971774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:59.973196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:59.982527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1218/2430] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:00.058757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e531c-3499-43dd-bb2a-84bac443ea4c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:00.068265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e531c-3499-43dd-bb2a-84bac443ea4c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:00.072649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278691-6937-4910-a539-802f427ec9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:00.073316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278691-6937-4910-a539-802f427ec9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:00.073640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278691-6937-4910-a539-802f427ec9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:00.073920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278691-6937-4910-a539-802f427ec9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:00.129766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278691-6937-4910-a539-802f427ec9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:00.131181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278691-6937-4910-a539-802f427ec9e5 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:00.140456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1213/2431] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:04.772298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:04.834698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb25476-c8e1-4d15-b92c-0a3a1b48e667 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:04.839234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:04.840090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:04.840374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:04.840650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] PATH_INFO: `/v3/users/d5125e3617a0486da105d0685ace9363` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:04.841857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5125e3617a0486da105d0685ace9363)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:04.843764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:04.890083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5125e3617a0486da105d0685ace9363'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:04.890659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5125e3617a0486da105d0685ace9363'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:04.897724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5125e3617a0486da105d0685ace9363'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:04.902298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:04.911663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5125e3617a0486da105d0685ace9363'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:04.912462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5125e3617a0486da105d0685ace9363'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:04.925450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1219/2432] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:26:04 2022] DELETE /identity/v3/users/d5125e3617a0486da105d0685ace9363 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:04.930089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:04.930567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:04.930665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:04.948495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:04.949742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:05.014064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1214/2433] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:05.023895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:05.025883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:05.090229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55640692-a48c-4282-a97d-5ada3754980e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:05.093858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:05.094501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:05.094786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:05.095067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:05.104023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:05.105447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:05.114902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1220/2434] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:05.384564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:05.386051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:05.399035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325930cd-2f1f-4fba-a72d-61a26fd2bda3 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:05.404570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:05.405528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:05.405819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:05.406104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] PATH_INFO: `/v3/projects/ccfa7817ae63473481ae2a9969f2c269` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:05.407336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfa7817ae63473481ae2a9969f2c269)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:05.409406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:05.455795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfa7817ae63473481ae2a9969f2c269', 'request_id': 'req-e4ece696-582e-4068-8c68-e100dff88d05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.462058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfa7817ae63473481ae2a9969f2c269', 'request_id': 'req-e4ece696-582e-4068-8c68-e100dff88d05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.469506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfa7817ae63473481ae2a9969f2c269', 'request_id': 'req-e4ece696-582e-4068-8c68-e100dff88d05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.480284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] The token cache is being invalidate because project ccfa7817ae63473481ae2a9969f2c269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:26:05.480565 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.481207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.482793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1215/2435] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:26:05 2022] DELETE /identity/v3/projects/ccfa7817ae63473481ae2a9969f2c269 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:05.486758 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:05.497057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee3fee-1563-41fb-b456-f6aa56240575 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:05.552232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:05.553089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:05.553374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:05.553679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] PATH_INFO: `/v3/users/db8aa59e3964471f9660ffdc0f7fe79b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:05.554878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8aa59e3964471f9660ffdc0f7fe79b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:05.557397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:05.601728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8aa59e3964471f9660ffdc0f7fe79b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.602374 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8aa59e3964471f9660ffdc0f7fe79b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.609744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8aa59e3964471f9660ffdc0f7fe79b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.621929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8aa59e3964471f9660ffdc0f7fe79b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.622562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b018e549-79c8-4094-bbad-c8eb0ff4d4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8aa59e3964471f9660ffdc0f7fe79b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:05.630001 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:05.635496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1221/2436] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:26:05 2022] DELETE /identity/v3/users/db8aa59e3964471f9660ffdc0f7fe79b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:05.908747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:05.910338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:05.926428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece696-582e-4068-8c68-e100dff88d05 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:05.947314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:05.988292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:05.989146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:05.989429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:05.989733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] PATH_INFO: `/v3/projects/a663ccbadce04814814ed6b915cbf7f1` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:05.990956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a663ccbadce04814814ed6b915cbf7f1)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:05.992872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.051229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a663ccbadce04814814ed6b915cbf7f1', 'request_id': 'req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:06.058195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a663ccbadce04814814ed6b915cbf7f1', 'request_id': 'req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:06.066359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a663ccbadce04814814ed6b915cbf7f1', 'request_id': 'req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:06.078133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] The token cache is being invalidate because project a663ccbadce04814814ed6b915cbf7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:26:06.078423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:06.079058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90f9f2f2-de8a-4ec2-bda4-974c5e28910d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:06.080575 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1216/2437] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:26:05 2022] DELETE /identity/v3/projects/a663ccbadce04814814ed6b915cbf7f1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:26:06.085733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223337e2-97ed-49d8-8554-bad7c8234715 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.086204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223337e2-97ed-49d8-8554-bad7c8234715 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.086313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223337e2-97ed-49d8-8554-bad7c8234715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.104503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-223337e2-97ed-49d8-8554-bad7c8234715 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:06.106093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-223337e2-97ed-49d8-8554-bad7c8234715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:06.169102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1222/2438] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:06.176771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d799d63-441f-46d8-8038-af2e3abd02f2 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.177132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d799d63-441f-46d8-8038-af2e3abd02f2 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.177516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d799d63-441f-46d8-8038-af2e3abd02f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.196851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-1d799d63-441f-46d8-8038-af2e3abd02f2 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:06.198144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1d799d63-441f-46d8-8038-af2e3abd02f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:06.207015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1217/2439] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:06.211761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223337e2-97ed-49d8-8554-bad7c8234715 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.221547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223337e2-97ed-49d8-8554-bad7c8234715 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.226176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.226834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.227121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.227412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.228650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:26:06.228959 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.230583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.242048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1223/2440] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:26:06.246859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d799d63-441f-46d8-8038-af2e3abd02f2 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.256066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d799d63-441f-46d8-8038-af2e3abd02f2 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.260783 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.261427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.261747 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.262022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.262720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.264604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.292487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1218/2441] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:26:06 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:06.293797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.304137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4efc1-9a91-4a17-905b-27398520db37 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.361996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.362666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.362952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.363236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.363938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.365876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.386406 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1224/2442] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:26:06 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:06.390263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.400579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa048e3-016b-4396-9275-9acd326f942d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.405486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.406151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.406432 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.406705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.407427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.409001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.419911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1219/2443] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:26:06.423794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.434265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b75ac-5b39-4156-b975-cd81d6c4fedf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.438821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b424b9-29e3-45fb-b6be-dbf5bd748d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.439466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b424b9-29e3-45fb-b6be-dbf5bd748d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.439746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b424b9-29e3-45fb-b6be-dbf5bd748d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.440022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b424b9-29e3-45fb-b6be-dbf5bd748d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.440737 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b424b9-29e3-45fb-b6be-dbf5bd748d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.442354 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b424b9-29e3-45fb-b6be-dbf5bd748d64 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.452027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1225/2444] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:06.456333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.466313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581d93-b2b4-42ee-a794-0ef3aa928ab7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.476089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.476977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.477257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.478086 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] PATH_INFO: `/v3/projects/272f3c16fc3144c0ac2d268051298d9d/users/4559c0a09a5649c19e04d111190122f8/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.492947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=272f3c16fc3144c0ac2d268051298d9d, user_id=4559c0a09a5649c19e04d111190122f8, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.496293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.509515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1220/2445] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:26:06 2022] PUT /identity/v3/projects/272f3c16fc3144c0ac2d268051298d9d/users/4559c0a09a5649c19e04d111190122f8/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:06.520863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a92a-dd7d-4b01-9eb4-8124b0d0aff3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.521152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a92a-dd7d-4b01-9eb4-8124b0d0aff3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.521429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a92a-dd7d-4b01-9eb4-8124b0d0aff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.548067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-88b8a92a-dd7d-4b01-9eb4-8124b0d0aff3 None None] MFA Rules not processed for user `4559c0a09a5649c19e04d111190122f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:06.549272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-88b8a92a-dd7d-4b01-9eb4-8124b0d0aff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:06.603261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:06.614021 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1226/2446] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:06.618997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.666969 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:06.682511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2a2c-2f8d-4f1c-ad79-5ba927e59bda admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.687129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.687788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.688074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.688353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.689087 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.691099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.716119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1221/2447] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:26:06 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:06.720200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a92a-dd7d-4b01-9eb4-8124b0d0aff3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.730865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a92a-dd7d-4b01-9eb4-8124b0d0aff3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.786325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.787025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.787312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.787651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.788336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.790435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.810358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1227/2448] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:26:06 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:06.814210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.824921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670de36-cf8f-40c3-b55d-5cbea39b600c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.829451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.830133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.830418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.830697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.831716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.833299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.843848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1222/2449] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:06.847622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.857282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710737ad-9b3e-427c-9e45-111bdad628d3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.861825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.862690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.862971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.863243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] PATH_INFO: `/v3/projects/bc45f7f10cf745faa67927128265cf3c/users/1a43fe737471461ea08bb7e5ac9f0e51/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.877910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc45f7f10cf745faa67927128265cf3c, user_id=1a43fe737471461ea08bb7e5ac9f0e51, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.880514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.893919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1228/2450] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:26:06 2022] PUT /identity/v3/projects/bc45f7f10cf745faa67927128265cf3c/users/1a43fe737471461ea08bb7e5ac9f0e51/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:06.897736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.907644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0038-54aa-4a27-a1c6-b86cb5cbcd4a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.965112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb39b9-8732-4f5a-834c-84a6faf07477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.965771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb39b9-8732-4f5a-834c-84a6faf07477 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.966044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb39b9-8732-4f5a-834c-84a6faf07477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:06.966320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb39b9-8732-4f5a-834c-84a6faf07477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:06.967062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb39b9-8732-4f5a-834c-84a6faf07477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:06.968633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb39b9-8732-4f5a-834c-84a6faf07477 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:06.978833 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1223/2451] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:06.982860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:06.994088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51ee3e-37e3-453d-9e18-05de2d81d602 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:06.998794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:06.999677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:06.999963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:07.000243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] PATH_INFO: `/v3/projects/bc45f7f10cf745faa67927128265cf3c/users/1a43fe737471461ea08bb7e5ac9f0e51/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:07.002334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc45f7f10cf745faa67927128265cf3c, user_id=1a43fe737471461ea08bb7e5ac9f0e51, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:07.004989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:07.015512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1229/2452] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:26:06 2022] PUT /identity/v3/projects/bc45f7f10cf745faa67927128265cf3c/users/1a43fe737471461ea08bb7e5ac9f0e51/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:07.025397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d810a2-4f70-46a3-8a9b-327e24b1a98f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:07.025720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d810a2-4f70-46a3-8a9b-327e24b1a98f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:07.026008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d810a2-4f70-46a3-8a9b-327e24b1a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:07.052928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b5d810a2-4f70-46a3-8a9b-327e24b1a98f None None] MFA Rules not processed for user `1a43fe737471461ea08bb7e5ac9f0e51`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:07.054178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b5d810a2-4f70-46a3-8a9b-327e24b1a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:07.132384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1224/2453] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:07.142365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:07.144224 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:07.202023 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f518027-0f18-4d42-9d18-51df6e2fc697 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:07.205717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfe06f-3cbd-457b-915e-45b63715f0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:07.206619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfe06f-3cbd-457b-915e-45b63715f0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:07.206906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfe06f-3cbd-457b-915e-45b63715f0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:07.207187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfe06f-3cbd-457b-915e-45b63715f0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:07.216342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfe06f-3cbd-457b-915e-45b63715f0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:07.218038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfe06f-3cbd-457b-915e-45b63715f0e6 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:07.229334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1230/2454] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:07.746467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d810a2-4f70-46a3-8a9b-327e24b1a98f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:07.790666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:07.809089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d810a2-4f70-46a3-8a9b-327e24b1a98f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:07.813850 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:07.814717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:07.815011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:07.815278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] PATH_INFO: `/v3/users/4559c0a09a5649c19e04d111190122f8` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:07.816469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4559c0a09a5649c19e04d111190122f8)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:07.818652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:07.863345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4559c0a09a5649c19e04d111190122f8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:07.863985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4559c0a09a5649c19e04d111190122f8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:07.876019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4559c0a09a5649c19e04d111190122f8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:07.876641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4559c0a09a5649c19e04d111190122f8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:07.883700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4559c0a09a5649c19e04d111190122f8'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:07.896257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1225/2455] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:26:07 2022] DELETE /identity/v3/users/4559c0a09a5649c19e04d111190122f8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:07.900846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:07.901154 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:07.901414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:07.920620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:07.921846 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:07.964015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:07.980190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1231/2456] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:26:07.989670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:07.991045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:08.047641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3094-4cfc-43cb-80b9-041ce77c485f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:08.051273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:08.051912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:08.052193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:08.052466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:08.061292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:08.062732 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:08.071988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1226/2457] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:08.344389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:08.346091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:08.363094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8b30b-b4ff-4c28-90b4-a17c1082765b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:08.367704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:08.369192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:08.369360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:08.369669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] PATH_INFO: `/v3/projects/272f3c16fc3144c0ac2d268051298d9d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:08.370855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=272f3c16fc3144c0ac2d268051298d9d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:08.372760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:08.419733 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272f3c16fc3144c0ac2d268051298d9d', 'request_id': 'req-6134fb1d-a506-4bbe-b386-ebd8a16319dc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.427031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272f3c16fc3144c0ac2d268051298d9d', 'request_id': 'req-6134fb1d-a506-4bbe-b386-ebd8a16319dc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.434296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272f3c16fc3144c0ac2d268051298d9d', 'request_id': 'req-6134fb1d-a506-4bbe-b386-ebd8a16319dc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.444638 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] The token cache is being invalidate because project 272f3c16fc3144c0ac2d268051298d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:26:08.444923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.445588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.447294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1232/2458] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:26:08 2022] DELETE /identity/v3/projects/272f3c16fc3144c0ac2d268051298d9d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:08.451272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:08.461047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121cb29-1db6-4280-bf3d-7d498c970765 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:08.515839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:08.516714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:08.517002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:08.517285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] PATH_INFO: `/v3/users/1a43fe737471461ea08bb7e5ac9f0e51` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:08.518602 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a43fe737471461ea08bb7e5ac9f0e51)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:08.520674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:08.526122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:08.567235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a43fe737471461ea08bb7e5ac9f0e51'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.567904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a43fe737471461ea08bb7e5ac9f0e51'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.579665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a43fe737471461ea08bb7e5ac9f0e51'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.580292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a43fe737471461ea08bb7e5ac9f0e51'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.587752 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-dec5f29c-678a-43e8-ba13-bb188ff176c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a43fe737471461ea08bb7e5ac9f0e51'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.599860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1227/2459] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:26:08 2022] DELETE /identity/v3/users/1a43fe737471461ea08bb7e5ac9f0e51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:08.861293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:08.862775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:08.878897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134fb1d-a506-4bbe-b386-ebd8a16319dc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:08.937188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:08.938062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:08.938341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:08.938611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] PATH_INFO: `/v3/projects/bc45f7f10cf745faa67927128265cf3c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:08.939769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc45f7f10cf745faa67927128265cf3c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:08.941675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:08.986288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc45f7f10cf745faa67927128265cf3c', 'request_id': 'req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.993724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc45f7f10cf745faa67927128265cf3c', 'request_id': 'req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:08.999815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc45f7f10cf745faa67927128265cf3c', 'request_id': 'req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:09.010498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] The token cache is being invalidate because project bc45f7f10cf745faa67927128265cf3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:26:09.010778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:09.011407 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fb594ed-5bc3-46f7-bf42-9dd1e6db8791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:09.012891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1233/2460] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:26:08 2022] DELETE /identity/v3/projects/bc45f7f10cf745faa67927128265cf3c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:09.017845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbac35-be28-4fab-899a-d20340b07019 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.018345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbac35-be28-4fab-899a-d20340b07019 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.018450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbac35-be28-4fab-899a-d20340b07019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.036713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-76bbac35-be28-4fab-899a-d20340b07019 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:09.037992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-76bbac35-be28-4fab-899a-d20340b07019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:09.095777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1228/2461] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:09.103793 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546fb47-67e1-49b3-9924-a390fbb7dbd4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.104084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546fb47-67e1-49b3-9924-a390fbb7dbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.104366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546fb47-67e1-49b3-9924-a390fbb7dbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.110726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:09.124875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f546fb47-67e1-49b3-9924-a390fbb7dbd4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:09.126130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f546fb47-67e1-49b3-9924-a390fbb7dbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:09.134950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1234/2462] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:09.139074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbac35-be28-4fab-899a-d20340b07019 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:09.148862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbac35-be28-4fab-899a-d20340b07019 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:09.153477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:09.154137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.154422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.154702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.155430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:26:09.155796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:09.157315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:09.169636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1229/2463] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:26:09.173929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546fb47-67e1-49b3-9924-a390fbb7dbd4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:09.183914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546fb47-67e1-49b3-9924-a390fbb7dbd4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:09.188550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:09.189745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.189745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.190017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.190597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:09.192645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:09.222668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1235/2464] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:26:09 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:26:09.223845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:09.234471 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032983-3b4b-42a5-bcf4-784bfbc6b662 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:09.290918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:09.291521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.291803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.292075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.292762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:09.294685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:09.317229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1230/2465] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:26:09 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:26:09.318381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:09.328514 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad938a1-9f8e-4002-a0c6-2f3ad2bdead4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:09.333356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:09.334056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.334399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.334847 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.335408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:09.337033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:09.347865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1236/2466] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:09.351848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:09.357933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:09.364311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f38a14-8999-43f7-9c0c-cffb79d61f45 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:09.370594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5af80-f530-4b71-98bf-147a2a8705cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:09.371275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5af80-f530-4b71-98bf-147a2a8705cc admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.371561 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5af80-f530-4b71-98bf-147a2a8705cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.371840 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5af80-f530-4b71-98bf-147a2a8705cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.372566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5af80-f530-4b71-98bf-147a2a8705cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:09.374209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5af80-f530-4b71-98bf-147a2a8705cc admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:09.384100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1231/2467] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:09.388196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:09.398181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bad3f-9feb-4015-8f4c-09882a940533 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:09.402754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:09.403627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.403914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.404190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] PATH_INFO: `/v3/projects/393298a811fb473d8ff18c9ec7d2a84c/users/cbba467fa7d4411a830c603388ead753/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.418896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=393298a811fb473d8ff18c9ec7d2a84c, user_id=cbba467fa7d4411a830c603388ead753, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:09.421607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:09.434955 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1237/2468] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:26:09 2022] PUT /identity/v3/projects/393298a811fb473d8ff18c9ec7d2a84c/users/cbba467fa7d4411a830c603388ead753/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:09.445871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979ee1-1dab-4fc8-8056-299d61dc3cdc None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.446165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979ee1-1dab-4fc8-8056-299d61dc3cdc None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.446473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979ee1-1dab-4fc8-8056-299d61dc3cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.472187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-48979ee1-1dab-4fc8-8056-299d61dc3cdc None None] MFA Rules not processed for user `cbba467fa7d4411a830c603388ead753`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:09.473383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-48979ee1-1dab-4fc8-8056-299d61dc3cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:09.536955 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1232/2469] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:09.549537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:09.551225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:09.626699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0866bd4-e458-4264-b6e7-c2559e97a68d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:09.630461 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8b11-79a6-46ba-be8e-8aae07ac3669 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca9f55fa22844a31ba5bc9bff04ab67d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:09.631096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8b11-79a6-46ba-be8e-8aae07ac3669 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:09.631410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8b11-79a6-46ba-be8e-8aae07ac3669 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:09.631685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8b11-79a6-46ba-be8e-8aae07ac3669 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:09.639930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b8b11-79a6-46ba-be8e-8aae07ac3669 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:09.641339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b8b11-79a6-46ba-be8e-8aae07ac3669 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:09.650044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1238/2470] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:19.533678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=36 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:19.646111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=61,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:31.334156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979ee1-1dab-4fc8-8056-299d61dc3cdc None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:31.398496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979ee1-1dab-4fc8-8056-299d61dc3cdc None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:31.403171 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:31.404037 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:31.404317 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:31.404591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] PATH_INFO: `/v3/users/cbba467fa7d4411a830c603388ead753` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:31.405814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbba467fa7d4411a830c603388ead753)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:31.407725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:31.452539 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbba467fa7d4411a830c603388ead753'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:31.453196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbba467fa7d4411a830c603388ead753'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:31.465345 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbba467fa7d4411a830c603388ead753'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:31.466059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbba467fa7d4411a830c603388ead753'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:31.473862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbba467fa7d4411a830c603388ead753'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:31.485945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1233/2471] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:26:31 2022] DELETE /identity/v3/users/cbba467fa7d4411a830c603388ead753 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:31.490449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:31.490905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:31.491012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:31.508472 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:31.509689 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:31.566261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1239/2472] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:31.576249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:31.577682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:31.635750 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf87b6-db90-410e-a73e-7dbd2a3a34a2 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:31.639536 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07239a1-663c-480b-80c2-b50b7f81eee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:31.640176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07239a1-663c-480b-80c2-b50b7f81eee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:31.640459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07239a1-663c-480b-80c2-b50b7f81eee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:31.640736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07239a1-663c-480b-80c2-b50b7f81eee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:31.649733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07239a1-663c-480b-80c2-b50b7f81eee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:31.651142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07239a1-663c-480b-80c2-b50b7f81eee2 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:31.660405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1234/2473] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:31.920764 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:31.922344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:31.936537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3695bc-e025-464e-b35e-bd7ffe9872ca None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:31.941110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:31.942561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:31.942850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:31.943275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] PATH_INFO: `/v3/projects/393298a811fb473d8ff18c9ec7d2a84c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:31.944586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393298a811fb473d8ff18c9ec7d2a84c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:31.946669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:31.992604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393298a811fb473d8ff18c9ec7d2a84c', 'request_id': 'req-dcd42366-1009-4092-ad76-c4270c7204d7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:31.999744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393298a811fb473d8ff18c9ec7d2a84c', 'request_id': 'req-dcd42366-1009-4092-ad76-c4270c7204d7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:32.005796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393298a811fb473d8ff18c9ec7d2a84c', 'request_id': 'req-dcd42366-1009-4092-ad76-c4270c7204d7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:32.015874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] The token cache is being invalidate because project 393298a811fb473d8ff18c9ec7d2a84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:26:32.016160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:32.016787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dcd42366-1009-4092-ad76-c4270c7204d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:32.018338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1240/2474] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:26:31 2022] DELETE /identity/v3/projects/393298a811fb473d8ff18c9ec7d2a84c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:32.023223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13445-9d11-41c1-95a3-6e5414d28121 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.023509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13445-9d11-41c1-95a3-6e5414d28121 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.023820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13445-9d11-41c1-95a3-6e5414d28121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.041636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-34c13445-9d11-41c1-95a3-6e5414d28121 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:32.042836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-34c13445-9d11-41c1-95a3-6e5414d28121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:32.059686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:32.102970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1235/2475] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:32.111220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da0e7f-91a0-4b3e-b98d-b2d70adfae93 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.111498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da0e7f-91a0-4b3e-b98d-b2d70adfae93 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.111774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da0e7f-91a0-4b3e-b98d-b2d70adfae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.130882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b6da0e7f-91a0-4b3e-b98d-b2d70adfae93 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:32.132099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b6da0e7f-91a0-4b3e-b98d-b2d70adfae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:32.140266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1241/2476] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:32.144463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13445-9d11-41c1-95a3-6e5414d28121 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:32.154903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13445-9d11-41c1-95a3-6e5414d28121 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:32.159880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:32.160535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.160821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.161098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.161935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:26:32.162252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:32.163862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:32.176028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1236/2477] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:26:32.180088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da0e7f-91a0-4b3e-b98d-b2d70adfae93 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:32.189391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da0e7f-91a0-4b3e-b98d-b2d70adfae93 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:32.194120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:32.194775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.195061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.195343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.196104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:32.198050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:32.223785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1242/2478] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:26:32 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:32.227846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:32.238414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3cdb8-afed-4b10-9c89-8c16d53a2a80 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:32.300931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:32.305900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.305900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.305900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.305900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:32.305900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:32.335551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1237/2479] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:26:32 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:26:32.339660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:32.351475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ed529-df0f-4f98-a19e-8c2a0a3258e1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:32.356546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:32.357282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.357663 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.358073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.358874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:32.360546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:32.371677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1243/2480] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:26:32.375537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:32.385746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d253608-1675-4dc3-8f0b-6ed5736af463 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:32.391394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977a1e6-c6b1-49ed-98c3-217353bbc265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:32.392055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977a1e6-c6b1-49ed-98c3-217353bbc265 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.392341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977a1e6-c6b1-49ed-98c3-217353bbc265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.392619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977a1e6-c6b1-49ed-98c3-217353bbc265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.393350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977a1e6-c6b1-49ed-98c3-217353bbc265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:32.394992 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977a1e6-c6b1-49ed-98c3-217353bbc265 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:32.409381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1238/2481] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:26:32.410608 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:32.421131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a7f6-310d-467a-be65-0d417def8cfc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:32.425831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:32.426707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.426991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.427266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] PATH_INFO: `/v3/projects/469539269643495bae0d6f5aac89f36e/users/6a5c39917bb244f5aeb4d449147c5e05/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.441671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469539269643495bae0d6f5aac89f36e, user_id=6a5c39917bb244f5aeb4d449147c5e05, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:32.444310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:32.457692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1244/2482] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:26:32 2022] PUT /identity/v3/projects/469539269643495bae0d6f5aac89f36e/users/6a5c39917bb244f5aeb4d449147c5e05/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:32.468533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2647f-e678-4391-93de-780886b1eada None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.468829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2647f-e678-4391-93de-780886b1eada None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.469136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2647f-e678-4391-93de-780886b1eada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.494745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-dfb2647f-e678-4391-93de-780886b1eada None None] MFA Rules not processed for user `6a5c39917bb244f5aeb4d449147c5e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:32.495948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-dfb2647f-e678-4391-93de-780886b1eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:32.558846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1239/2483] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:32.569090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:32.570759 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:32.594067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:32.629392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61d02-404a-4fcd-8cd3-31df2f175f26 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:32.632947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc5d9e-a7c0-448e-8825-9ac093dcf762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:32.633619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc5d9e-a7c0-448e-8825-9ac093dcf762 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:32.633900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc5d9e-a7c0-448e-8825-9ac093dcf762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:32.634173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc5d9e-a7c0-448e-8825-9ac093dcf762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:32.642849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc5d9e-a7c0-448e-8825-9ac093dcf762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:32.644259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc5d9e-a7c0-448e-8825-9ac093dcf762 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:32.652845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1245/2484] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:41.997250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2647f-e678-4391-93de-780886b1eada None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:42.015790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:42.060367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2647f-e678-4391-93de-780886b1eada None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:42.064884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:42.065769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.066054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.066336 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] PATH_INFO: `/v3/users/6a5c39917bb244f5aeb4d449147c5e05` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.067504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5c39917bb244f5aeb4d449147c5e05)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:42.069437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:42.114972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5c39917bb244f5aeb4d449147c5e05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.115627 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5c39917bb244f5aeb4d449147c5e05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.127616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5c39917bb244f5aeb4d449147c5e05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.128275 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5c39917bb244f5aeb4d449147c5e05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.135647 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5c39917bb244f5aeb4d449147c5e05'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.149257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1240/2485] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:26:41 2022] DELETE /identity/v3/users/6a5c39917bb244f5aeb4d449147c5e05 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:42.154370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.154829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.154948 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.171388 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:42.172577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:42.237264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1246/2486] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:42.246910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:42.248303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:42.305143 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68415-92d9-4ec6-9526-5089280de948 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:42.308753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a7da3-9164-466f-9d46-8cf4180b6e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:42.309387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7da3-9164-466f-9d46-8cf4180b6e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.309699 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7da3-9164-466f-9d46-8cf4180b6e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.309975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7da3-9164-466f-9d46-8cf4180b6e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.318745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7da3-9164-466f-9d46-8cf4180b6e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:42.320165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7da3-9164-466f-9d46-8cf4180b6e33 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:42.329871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1241/2487] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:42.586255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:42.587664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:42.600144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ae643-ebc6-425f-b0ef-b54a13dacdcd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:42.604785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:42.605671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.605960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.606225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] PATH_INFO: `/v3/projects/469539269643495bae0d6f5aac89f36e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.607496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=469539269643495bae0d6f5aac89f36e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:42.614602 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:42.662956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469539269643495bae0d6f5aac89f36e', 'request_id': 'req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.669348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469539269643495bae0d6f5aac89f36e', 'request_id': 'req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.675364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469539269643495bae0d6f5aac89f36e', 'request_id': 'req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.685949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] The token cache is being invalidate because project 469539269643495bae0d6f5aac89f36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:26:42.686236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.686862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7b011ac8-a07f-4f1f-8df4-79ff2cdb2bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:42.688367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1247/2488] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:26:42 2022] DELETE /identity/v3/projects/469539269643495bae0d6f5aac89f36e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:42.693170 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c0bf-a4a7-466e-bca8-8be4b81141ce None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.693480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c0bf-a4a7-466e-bca8-8be4b81141ce None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.693756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c0bf-a4a7-466e-bca8-8be4b81141ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.712013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-86f1c0bf-a4a7-466e-bca8-8be4b81141ce None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:42.713241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-86f1c0bf-a4a7-466e-bca8-8be4b81141ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:42.745772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:42.774614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1242/2489] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:26:42.782142 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98217ed-5ca6-45e8-b151-c014885ce64b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.782370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98217ed-5ca6-45e8-b151-c014885ce64b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.791290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98217ed-5ca6-45e8-b151-c014885ce64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.803090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d98217ed-5ca6-45e8-b151-c014885ce64b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:42.804298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d98217ed-5ca6-45e8-b151-c014885ce64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:42.812825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1248/2490] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:42.817089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c0bf-a4a7-466e-bca8-8be4b81141ce None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:42.834230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c0bf-a4a7-466e-bca8-8be4b81141ce None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:42.839019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:42.839676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.839959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.840233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.841011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:26:42.841321 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:42.842945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:42.854920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1243/2491] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:26:42.859414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98217ed-5ca6-45e8-b151-c014885ce64b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:42.868828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98217ed-5ca6-45e8-b151-c014885ce64b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:42.874238 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:42.874968 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.875250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.875527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.876229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:42.878182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:42.904990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1249/2492] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:26:42 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:26:42.908997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:42.919462 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938508f-909f-4726-aded-b58dc21afbba admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:42.975671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:42.976328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:42.976609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:42.976884 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:42.977585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:42.979469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:42.999498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1244/2493] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:26:42 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:43.003571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:43.013677 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3934a8-11dd-41d0-8515-98ecc12b9075 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:43.018250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:43.018841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:43.019122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:43.019394 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:43.020105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:43.021723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:43.031787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1250/2494] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:43.035381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:43.045720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cf08e-2c65-4cdb-9d1e-1a2c24b6008b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:43.050322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad68888-39c9-4c81-8952-31c3292f8c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:43.050957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68888-39c9-4c81-8952-31c3292f8c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:43.051241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68888-39c9-4c81-8952-31c3292f8c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:43.051511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68888-39c9-4c81-8952-31c3292f8c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:43.052221 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad68888-39c9-4c81-8952-31c3292f8c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:43.053838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad68888-39c9-4c81-8952-31c3292f8c66 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:43.064296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1245/2495] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:26:43.068265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:43.078104 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e6d90-ee7c-402e-82b3-508e30925d4e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:43.082878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:43.083730 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:43.084008 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:43.084279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] PATH_INFO: `/v3/projects/3b974e895a3646d59e00a1d0831665ae/users/4f04ee03a9cf463f833bf25177fb8654/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:43.086475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:43.101091 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b974e895a3646d59e00a1d0831665ae, user_id=4f04ee03a9cf463f833bf25177fb8654, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:43.103752 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:43.116395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1251/2496] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:26:43 2022] PUT /identity/v3/projects/3b974e895a3646d59e00a1d0831665ae/users/4f04ee03a9cf463f833bf25177fb8654/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:43.127047 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63629-c587-463b-aa39-f566806e2378 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:43.127344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63629-c587-463b-aa39-f566806e2378 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:43.127630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63629-c587-463b-aa39-f566806e2378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:43.153678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3ef63629-c587-463b-aa39-f566806e2378 None None] MFA Rules not processed for user `4f04ee03a9cf463f833bf25177fb8654`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:43.154880 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3ef63629-c587-463b-aa39-f566806e2378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:43.219697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1246/2497] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:43.235219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:43.236882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:43.292206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724cac-1277-4560-978d-876af0ece5c0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:43.296227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a13cb-fafd-4e2e-b282-260ac93b2658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:43.296859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a13cb-fafd-4e2e-b282-260ac93b2658 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:43.297144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a13cb-fafd-4e2e-b282-260ac93b2658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:43.297422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a13cb-fafd-4e2e-b282-260ac93b2658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:43.305594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a13cb-fafd-4e2e-b282-260ac93b2658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:43.307018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a13cb-fafd-4e2e-b282-260ac93b2658 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:43.315780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1252/2498] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:45.836881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63629-c587-463b-aa39-f566806e2378 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:45.876831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:45.904395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63629-c587-463b-aa39-f566806e2378 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:45.909110 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:45.910134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:45.910341 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:45.910611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] PATH_INFO: `/v3/users/4f04ee03a9cf463f833bf25177fb8654` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:45.911788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f04ee03a9cf463f833bf25177fb8654)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:45.913780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:45.975362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f04ee03a9cf463f833bf25177fb8654'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:45.976215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f04ee03a9cf463f833bf25177fb8654'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:45.989132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f04ee03a9cf463f833bf25177fb8654'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:45.989803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f04ee03a9cf463f833bf25177fb8654'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:45.998483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f04ee03a9cf463f833bf25177fb8654'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:46.016011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1247/2499] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:26:45 2022] DELETE /identity/v3/users/4f04ee03a9cf463f833bf25177fb8654 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:46.018424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.018918 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.019043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.035592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:46.036795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:46.095993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1253/2500] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:46.105497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.107420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:46.163209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b73729-7fc4-4b79-b22b-c41e202f82df admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.166898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0eece-d035-427f-bfea-e28d85780001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.167537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0eece-d035-427f-bfea-e28d85780001 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.167823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0eece-d035-427f-bfea-e28d85780001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.168099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0eece-d035-427f-bfea-e28d85780001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.177611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0eece-d035-427f-bfea-e28d85780001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.179034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0eece-d035-427f-bfea-e28d85780001 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.189018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1248/2501] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:46.446669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.448082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:46.460124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a1f6-d274-47e7-a3c5-3663de6b75c6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.464685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.466059 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.466340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.466831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] PATH_INFO: `/v3/projects/3b974e895a3646d59e00a1d0831665ae` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.468013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b974e895a3646d59e00a1d0831665ae)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.469972 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.515175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b974e895a3646d59e00a1d0831665ae', 'request_id': 'req-526ce0dc-3618-4221-bc70-0484db00e0a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:46.522747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b974e895a3646d59e00a1d0831665ae', 'request_id': 'req-526ce0dc-3618-4221-bc70-0484db00e0a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:46.529328 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b974e895a3646d59e00a1d0831665ae', 'request_id': 'req-526ce0dc-3618-4221-bc70-0484db00e0a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:46.539344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] The token cache is being invalidate because project 3b974e895a3646d59e00a1d0831665ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:26:46.539630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:46.540270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-526ce0dc-3618-4221-bc70-0484db00e0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:26:46.541823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1254/2502] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:26:46 2022] DELETE /identity/v3/projects/3b974e895a3646d59e00a1d0831665ae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:26:46.547506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d12d1-989a-4179-9de4-69460597b81b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.547802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d12d1-989a-4179-9de4-69460597b81b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.548080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d12d1-989a-4179-9de4-69460597b81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.565222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c25d12d1-989a-4179-9de4-69460597b81b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:46.566460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c25d12d1-989a-4179-9de4-69460597b81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:46.616465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:46.626762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1249/2503] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:26:46.635319 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed94c-754e-41bc-8ae1-ea92a610f41b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.635613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed94c-754e-41bc-8ae1-ea92a610f41b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.635896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed94c-754e-41bc-8ae1-ea92a610f41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.655902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cdbed94c-754e-41bc-8ae1-ea92a610f41b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:46.657108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cdbed94c-754e-41bc-8ae1-ea92a610f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:46.664976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1255/2504] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:46.669044 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d12d1-989a-4179-9de4-69460597b81b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.678703 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d12d1-989a-4179-9de4-69460597b81b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.683168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.683806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.684085 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.684355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.685065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:26:46.685367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.686988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.698191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1250/2505] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:26:46.702638 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed94c-754e-41bc-8ae1-ea92a610f41b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.707397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:46.714025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed94c-754e-41bc-8ae1-ea92a610f41b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.720181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.720824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.721103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.721377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.722129 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.724004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.748528 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1256/2506] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:26:46 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:46.752606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.762908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d836383-f7e6-4e24-af4a-f1b4486ab71c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.816422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.817172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.817453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.817757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.818435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.820354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.841362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1251/2507] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:26:46 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:26:46.845490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.855544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501deafd-8a72-4051-8bb5-393fd6f30ff5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.860022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.860662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.860942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.861214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.861980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.863685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.873862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1257/2508] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:46.877356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.887872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2445c-aa34-40a6-98b2-73687ddd4295 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.892378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc844bf6-a8d6-48a3-b568-660b0946e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.893028 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc844bf6-a8d6-48a3-b568-660b0946e2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.893312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc844bf6-a8d6-48a3-b568-660b0946e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.893629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc844bf6-a8d6-48a3-b568-660b0946e2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.894347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc844bf6-a8d6-48a3-b568-660b0946e2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.895921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc844bf6-a8d6-48a3-b568-660b0946e2fc admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.906518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1252/2509] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:26:46.910568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:46.920521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1cbb4-14c8-4d05-bf21-330791130378 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:46.925066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:46.925945 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.926222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.926492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] PATH_INFO: `/v3/projects/05bf1c6de3304fa099426edf600343c8/users/575be76f05c5465b944e22e81ddd699d/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.940605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bf1c6de3304fa099426edf600343c8, user_id=575be76f05c5465b944e22e81ddd699d, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:46.943301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:46.957243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1258/2510] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:26:46 2022] PUT /identity/v3/projects/05bf1c6de3304fa099426edf600343c8/users/575be76f05c5465b944e22e81ddd699d/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:26:46.967843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:46.968134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:46.968412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:46.997150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] MFA Rules not processed for user `575be76f05c5465b944e22e81ddd699d`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:26:46.998406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:47.073198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1253/2511] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:26:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:26:47.085286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:47.087017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:26:47.141966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76999d-fa3b-472e-abc1-aed07994aa72 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:47.145524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca9f55fa22844a31ba5bc9bff04ab67d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:47.146157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:47.146437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:47.146710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:47.154780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:47.156198 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:47.164709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1259/2512] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:57.062728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:57.160792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:01.750229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:01.751665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:01.809109 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad9d6-443f-4ae9-8c31-48466765e57d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:01.812751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57ecdd-bae1-4d23-b788-b0e351231533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:01.813394 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ecdd-bae1-4d23-b788-b0e351231533 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:01.813700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ecdd-bae1-4d23-b788-b0e351231533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:01.813974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ecdd-bae1-4d23-b788-b0e351231533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:01.815702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7f57ecdd-bae1-4d23-b788-b0e351231533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:01.872625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57ecdd-bae1-4d23-b788-b0e351231533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:01.874129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57ecdd-bae1-4d23-b788-b0e351231533 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:01.883010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1254/2513] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:11.878894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=48 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:18.871201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:18.931177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f18b1-ab43-41b1-8b97-976ebf85457f service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:18.935622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:18.936410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:18.936694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:18.937541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] PATH_INFO: `/v3/users/575be76f05c5465b944e22e81ddd699d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:18.938698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=575be76f05c5465b944e22e81ddd699d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:18.940593 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:18.984595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575be76f05c5465b944e22e81ddd699d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:18.985234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575be76f05c5465b944e22e81ddd699d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:18.992496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575be76f05c5465b944e22e81ddd699d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.005309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575be76f05c5465b944e22e81ddd699d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.005969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575be76f05c5465b944e22e81ddd699d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.018054 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1260/2514] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:18 2022] DELETE /identity/v3/users/575be76f05c5465b944e22e81ddd699d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:19.022483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.022954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.023077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.039598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:19.040788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:19.099248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1255/2515] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:19.109263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.110665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:19.165714 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a4dea-5253-4996-83b6-a4ad2d2626eb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.169235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649cb9-49a1-49c0-996b-e7ed244269c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.169888 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649cb9-49a1-49c0-996b-e7ed244269c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.170170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649cb9-49a1-49c0-996b-e7ed244269c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.170442 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649cb9-49a1-49c0-996b-e7ed244269c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.185141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649cb9-49a1-49c0-996b-e7ed244269c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.186648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649cb9-49a1-49c0-996b-e7ed244269c1 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:19.196093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1261/2516] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:19.470019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.471663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:19.489108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1205fcf-a5bf-4be2-bbbc-e11a7ff7795d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.502806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.503641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.503950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.504293 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] PATH_INFO: `/v3/projects/05bf1c6de3304fa099426edf600343c8` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.505453 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bf1c6de3304fa099426edf600343c8)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.507456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:19.556835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bf1c6de3304fa099426edf600343c8', 'request_id': 'req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.563665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bf1c6de3304fa099426edf600343c8', 'request_id': 'req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.571821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bf1c6de3304fa099426edf600343c8', 'request_id': 'req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.583916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] The token cache is being invalidate because project 05bf1c6de3304fa099426edf600343c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:19.584203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.584838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b11d2b0b-0f64-47c9-ab36-4d416c3fe16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:19.588643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1256/2517] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:19 2022] DELETE /identity/v3/projects/05bf1c6de3304fa099426edf600343c8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:19.597324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654786-5e46-4e39-823b-be33074c4d11 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.597640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654786-5e46-4e39-823b-be33074c4d11 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.597923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654786-5e46-4e39-823b-be33074c4d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.615844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-21654786-5e46-4e39-823b-be33074c4d11 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:19.617114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-21654786-5e46-4e39-823b-be33074c4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:19.633412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:19.676062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1262/2518] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:19.683659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c989f3-8bb1-4667-b335-b87f1c070508 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.683953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c989f3-8bb1-4667-b335-b87f1c070508 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.684237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c989f3-8bb1-4667-b335-b87f1c070508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.702928 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-58c989f3-8bb1-4667-b335-b87f1c070508 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:19.704092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-58c989f3-8bb1-4667-b335-b87f1c070508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:19.712229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1257/2519] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:19.716145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654786-5e46-4e39-823b-be33074c4d11 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.726455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654786-5e46-4e39-823b-be33074c4d11 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.731071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.731724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.732013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.732292 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.733020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:27:19.733333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.734963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:19.746805 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1263/2520] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:27:19.751102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c989f3-8bb1-4667-b335-b87f1c070508 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.760839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c989f3-8bb1-4667-b335-b87f1c070508 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.766155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.766821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.767100 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.767375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.768099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.770045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:19.798061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1258/2521] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:27:19 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:27:19.799172 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.809074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17156ae-c3a3-4410-94a3-05a2f0314c07 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.864884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.865583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.865875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.866153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.866907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.868780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:19.888823 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1264/2522] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:27:19 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:27:19.893482 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.903545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302905f-c986-4b91-a013-42810e04c521 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.908434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.909147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.909433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.909739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.910517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.912112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:19.923651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1259/2523] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:19.927409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.937632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47e776-3a8b-45dc-84e1-be760be7605c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.942114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cc1c0-174e-419e-8f43-72fc969fae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.942757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc1c0-174e-419e-8f43-72fc969fae4c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.943037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc1c0-174e-419e-8f43-72fc969fae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.943314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc1c0-174e-419e-8f43-72fc969fae4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.944033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cc1c0-174e-419e-8f43-72fc969fae4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.945637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cc1c0-174e-419e-8f43-72fc969fae4c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:19.956090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1265/2524] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:19.959785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:19.969596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98cf2e-9ca0-42ab-aa11-462857390ff5 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:19.974231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:19.975153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:19.975433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:19.975705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] PATH_INFO: `/v3/projects/1790fa011d5a48abb986365ae449eda5/users/1942d9ae332b4a4d8f9f077c1eab1da2/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:19.990382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1790fa011d5a48abb986365ae449eda5, user_id=1942d9ae332b4a4d8f9f077c1eab1da2, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:19.993373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:20.007918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1260/2525] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:19 2022] PUT /identity/v3/projects/1790fa011d5a48abb986365ae449eda5/users/1942d9ae332b4a4d8f9f077c1eab1da2/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:27:20.013047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba541ee-0118-48a4-88b0-71b39d536159 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:20.013341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba541ee-0118-48a4-88b0-71b39d536159 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:20.013654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba541ee-0118-48a4-88b0-71b39d536159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:20.032529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-aba541ee-0118-48a4-88b0-71b39d536159 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:20.033871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aba541ee-0118-48a4-88b0-71b39d536159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:20.095576 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1266/2526] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:20.105167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:20.107061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:20.129235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:20.165628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18f27-a64b-446d-a741-46d99242e526 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:20.169196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:20.169857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:20.170139 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:20.170409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:20.179151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:20.180558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:20.190283 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1261/2527] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:20.850481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a177e78-3a7f-4ea3-be94-0a72213ca652 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:20.850779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a177e78-3a7f-4ea3-be94-0a72213ca652 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:20.851041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a177e78-3a7f-4ea3-be94-0a72213ca652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:20.877867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2a177e78-3a7f-4ea3-be94-0a72213ca652 None None] MFA Rules not processed for user `1942d9ae332b4a4d8f9f077c1eab1da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:20.879074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2a177e78-3a7f-4ea3-be94-0a72213ca652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:20.896367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:20.949650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1267/2528] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:20.962724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:20.964553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:21.023376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ef278-c0a1-421b-84c7-c12e940358f9 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:21.026910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:21.027547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:21.027835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:21.028104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:21.036859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:21.038295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:21.046944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1262/2529] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:22.380014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:22.380492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:22.380597 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:22.397579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] MFA Rules not processed for user `1942d9ae332b4a4d8f9f077c1eab1da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:22.398826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:22.406005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1268/2530] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:27:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:22.634212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:22.644295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572f94b-ec7e-4839-b4ad-4ae3f647e616 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:22.647887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab3c92-cb18-497d-b993-b3905d1772d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:22.648522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3c92-cb18-497d-b993-b3905d1772d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:22.648832 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3c92-cb18-497d-b993-b3905d1772d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:22.649107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3c92-cb18-497d-b993-b3905d1772d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:22.651019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bbab3c92-cb18-497d-b993-b3905d1772d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:22.661601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab3c92-cb18-497d-b993-b3905d1772d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:22.663021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab3c92-cb18-497d-b993-b3905d1772d4 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:22.671291 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1263/2531] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:28.349774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:28.351232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:28.419276 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b86e5-d158-4e06-8d07-3b03863b2b1e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:28.424979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:28.425488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:28.425785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:28.426062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:28.427886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:28.440358 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:28.441989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:28.452699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1269/2532] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:27:29.320513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583828-e142-4f1f-a963-62b2f0df3aa0 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:29.320961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583828-e142-4f1f-a963-62b2f0df3aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:29.321063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583828-e142-4f1f-a963-62b2f0df3aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:29.368897 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-48583828-e142-4f1f-a963-62b2f0df3aa0 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:29.370133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-48583828-e142-4f1f-a963-62b2f0df3aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:29.438410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1264/2533] 10.222.0.47 () {58 vars in 967 bytes} [Thu Jun 30 13:27:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:29.482305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:29.484232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:29.573447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c356c-e89b-418c-9672-1da3b42a8e40 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:29.578426 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:29.579068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:29.579353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:29.579660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:29.587857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:29.589430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:29.597311 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1270/2534] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:27:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:27:30.011264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583828-e142-4f1f-a963-62b2f0df3aa0 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:30.021211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583828-e142-4f1f-a963-62b2f0df3aa0 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:30.024679 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60447d44-f528-4fff-a787-875988231172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:30.025318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60447d44-f528-4fff-a787-875988231172 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:30.025632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60447d44-f528-4fff-a787-875988231172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:30.025908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60447d44-f528-4fff-a787-875988231172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:30.028828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-60447d44-f528-4fff-a787-875988231172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:30.041072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60447d44-f528-4fff-a787-875988231172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:30.042543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60447d44-f528-4fff-a787-875988231172 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:30.052262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1265/2535] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:33.174370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.176418 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:33.193046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3b56-242a-4eba-9226-e7d653a8dd4d service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.198932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.199578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.199864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.200136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.203457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:33.219353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.220998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.225595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:33.241296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1271/2536] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:27:36.182420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60447d44-f528-4fff-a787-875988231172 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.183828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-60447d44-f528-4fff-a787-875988231172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:36.199010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60447d44-f528-4fff-a787-875988231172 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.205400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.207634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.208964 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.209078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] PATH_INFO: `/v3/users/a42029d5789548c0b56c5a6e69e0f80d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.212384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42029d5789548c0b56c5a6e69e0f80d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.215983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.224910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:36.278404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42029d5789548c0b56c5a6e69e0f80d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.279084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42029d5789548c0b56c5a6e69e0f80d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.294894 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42029d5789548c0b56c5a6e69e0f80d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.295658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42029d5789548c0b56c5a6e69e0f80d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.308895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42029d5789548c0b56c5a6e69e0f80d'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.331248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1266/2537] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:36 2022] DELETE /identity/v3/users/a42029d5789548c0b56c5a6e69e0f80d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:36.532317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.543565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc865-ed0a-4025-86e2-31ec17b5b1d8 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.605897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.606870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.607180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.607465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] PATH_INFO: `/v3/projects/9e76654020af4f7daf0dc9c7a94f8a4c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.609222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e76654020af4f7daf0dc9c7a94f8a4c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.611182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.657858 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e76654020af4f7daf0dc9c7a94f8a4c', 'request_id': 'req-9a44dc7a-c02c-4464-b85c-a454f7c0472b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.665235 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e76654020af4f7daf0dc9c7a94f8a4c', 'request_id': 'req-9a44dc7a-c02c-4464-b85c-a454f7c0472b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.671979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e76654020af4f7daf0dc9c7a94f8a4c', 'request_id': 'req-9a44dc7a-c02c-4464-b85c-a454f7c0472b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.681992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] The token cache is being invalidate because project 9e76654020af4f7daf0dc9c7a94f8a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:36.682277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.682935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.684667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1272/2538] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:36 2022] DELETE /identity/v3/projects/9e76654020af4f7daf0dc9c7a94f8a4c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:36.688543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.689958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:36.703093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af02e9b-592a-439c-a54e-bd07ee88341e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.758449 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.759310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.759591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.759866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] PATH_INFO: `/v3/users/d195d0af25184c98a03a8beabb8a1a26` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.761039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d195d0af25184c98a03a8beabb8a1a26)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.762968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.808821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd195d0af25184c98a03a8beabb8a1a26'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.809377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd195d0af25184c98a03a8beabb8a1a26'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.820872 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd195d0af25184c98a03a8beabb8a1a26'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.821517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd195d0af25184c98a03a8beabb8a1a26'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.828916 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd195d0af25184c98a03a8beabb8a1a26'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:36.841081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1267/2539] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:36 2022] DELETE /identity/v3/users/d195d0af25184c98a03a8beabb8a1a26 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:37.006683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:37.008242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:37.021669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44dc7a-c02c-4464-b85c-a454f7c0472b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:37.077651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:37.078422 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:37.078706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:37.078978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] PATH_INFO: `/v3/projects/428f32d5fbf84e66919032f77aa7ead6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:37.080152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428f32d5fbf84e66919032f77aa7ead6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:37.082360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:37.115227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:37.130304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428f32d5fbf84e66919032f77aa7ead6', 'request_id': 'req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:37.138025 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428f32d5fbf84e66919032f77aa7ead6', 'request_id': 'req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:37.144650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428f32d5fbf84e66919032f77aa7ead6', 'request_id': 'req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:37.154788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] The token cache is being invalidate because project 428f32d5fbf84e66919032f77aa7ead6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:37.155074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:37.155715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:37.157280 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1273/2540] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:37 2022] DELETE /identity/v3/projects/428f32d5fbf84e66919032f77aa7ead6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:46.837626 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:47.151680 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:40.842656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:40.844082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:40.901530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519041-d3ec-46cb-8240-0c0a046dab4d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:40.948861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:40.949520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:40.949803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:40.950077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:40.951794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:41.013003 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:41.014450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:41.023827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1268/2541] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:28:47.475437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:47.476984 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:47.491160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58bca2-01f2-44e0-8e5e-57e1e2b70b75 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:47.499205 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:47.500206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:47.500484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:47.500769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] PATH_INFO: `/v3/users/5d47cf730e0e46f8bd9cd9ef8743125d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:47.501985 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d47cf730e0e46f8bd9cd9ef8743125d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:47.503938 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:47.551923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d47cf730e0e46f8bd9cd9ef8743125d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.552573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d47cf730e0e46f8bd9cd9ef8743125d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.569776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d47cf730e0e46f8bd9cd9ef8743125d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.583401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d47cf730e0e46f8bd9cd9ef8743125d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.584486 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d47cf730e0e46f8bd9cd9ef8743125d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.597050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1274/2542] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:28:47 2022] DELETE /identity/v3/users/5d47cf730e0e46f8bd9cd9ef8743125d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:47.764716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:47.780808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606b0ff-bb80-4a73-b397-156b763949fc service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:47.841306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:47.842347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:47.842623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:47.842893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] PATH_INFO: `/v3/projects/b663be24dc3f48a3ac9ce0612174118c` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:47.844072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b663be24dc3f48a3ac9ce0612174118c)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:47.845999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:47.854739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:47.895165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b663be24dc3f48a3ac9ce0612174118c', 'request_id': 'req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.901188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b663be24dc3f48a3ac9ce0612174118c', 'request_id': 'req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.908408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b663be24dc3f48a3ac9ce0612174118c', 'request_id': 'req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.918768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] The token cache is being invalidate because project b663be24dc3f48a3ac9ce0612174118c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:28:47.919051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.919682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:47.921215 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1269/2543] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:28:47 2022] DELETE /identity/v3/projects/b663be24dc3f48a3ac9ce0612174118c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:47.925094 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:47.927041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:47.940620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132d68c-3616-41ae-a42b-624def93afbf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:47.996150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:47.997018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:47.997301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:47.997620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] PATH_INFO: `/v3/users/77df8062696d4bfabdfed301e55617be` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:47.998874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77df8062696d4bfabdfed301e55617be)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:48.000782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:48.046378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77df8062696d4bfabdfed301e55617be'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.046950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77df8062696d4bfabdfed301e55617be'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.054134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77df8062696d4bfabdfed301e55617be'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.065845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77df8062696d4bfabdfed301e55617be'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.066462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77df8062696d4bfabdfed301e55617be'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.069046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:48.080910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1275/2544] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:28:47 2022] DELETE /identity/v3/users/77df8062696d4bfabdfed301e55617be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:48.249922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:48.251344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:48.267316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4dd8-3eae-4d1c-87c6-1d20fe9609db admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:48.326525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:48.327334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:48.327618 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:48.327895 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] PATH_INFO: `/v3/projects/32d9e6d08e304d659d450e852d86c23d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:48.329066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d9e6d08e304d659d450e852d86c23d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:48.331244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:48.377397 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d9e6d08e304d659d450e852d86c23d', 'request_id': 'req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.383407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d9e6d08e304d659d450e852d86c23d', 'request_id': 'req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.390359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d9e6d08e304d659d450e852d86c23d', 'request_id': 'req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.400344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] The token cache is being invalidate because project 32d9e6d08e304d659d450e852d86c23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:28:48.400623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.401238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:48.402776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1270/2545] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:28:48 2022] DELETE /identity/v3/projects/32d9e6d08e304d659d450e852d86c23d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:58.078806 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:58.397417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:58.601562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:58.602971 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:58.660062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40942-5643-43b2-ab47-f7c9203dbe46 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:58.707377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:58.708024 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:58.708310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:58.708591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:58.710928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:58.777784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:58.779242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:58.790004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1276/2546] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:59.875910 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:59.877836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:59.890631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcea9f-061d-4f36-9aa9-b3fae3ac5e2e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:59.894503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:59.895167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:59.895436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:59.895713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:59.897976 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:59.911596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:59.913730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:59.924680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1271/2547] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:29:01.173532 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:01.175210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:01.232117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55bc5-2617-419a-9eba-b7dbe0e6feaf service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:01.235780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:01.236419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:01.236716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:01.236991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:01.238802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:01.248579 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:29:01.316673 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:01.318123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:01.336618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1277/2548] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:29:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:29:02.228771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:02.230167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:02.241970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632538eb-2340-4471-8fb3-7ce353a13f50 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:02.245729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:02.246364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:02.246646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:02.246917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:02.248643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:02.328160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:02.329530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:02.348368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1272/2549] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:29:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:29:11.333447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=35 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:29:12.345628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=47 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:29:48.185299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:48.194513 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881733f0-b628-4a2b-9066-9212288bdd51 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:48.198076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:48.198711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:48.198996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:48.199274 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:48.201012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:48.267572 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:48.269004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:48.278748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1278/2550] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:29:51.415485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:51.417118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:51.438174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40c3c8-3105-49be-9221-832d9a32aa39 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:51.442804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:51.443672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:51.443962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:51.444240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] PATH_INFO: `/v3/users/640e3ad3e6174e8e86333ae5c1a907ca` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:51.445430 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=640e3ad3e6174e8e86333ae5c1a907ca)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:51.447989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:51.492619 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640e3ad3e6174e8e86333ae5c1a907ca'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.493788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640e3ad3e6174e8e86333ae5c1a907ca'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.505693 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640e3ad3e6174e8e86333ae5c1a907ca'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.506322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640e3ad3e6174e8e86333ae5c1a907ca'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.514131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ad425917-5793-447c-97d9-807873fa5f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640e3ad3e6174e8e86333ae5c1a907ca'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.526477 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1273/2551] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:29:51 2022] DELETE /identity/v3/users/640e3ad3e6174e8e86333ae5c1a907ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:29:51.701411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:51.712043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f807f-d55b-4fee-b631-6d9e6b27719e service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:51.770781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:51.771623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:51.771906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:51.772181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] PATH_INFO: `/v3/projects/15273ac34cca4da1b9375524bade1873` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:51.773342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15273ac34cca4da1b9375524bade1873)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:51.775299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:51.820772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15273ac34cca4da1b9375524bade1873', 'request_id': 'req-660d0bc0-03dd-4c4b-992c-2181cf6648e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.828078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15273ac34cca4da1b9375524bade1873', 'request_id': 'req-660d0bc0-03dd-4c4b-992c-2181cf6648e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.834675 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15273ac34cca4da1b9375524bade1873', 'request_id': 'req-660d0bc0-03dd-4c4b-992c-2181cf6648e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.845897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] The token cache is being invalidate because project 15273ac34cca4da1b9375524bade1873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:29:51.846126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.846782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-660d0bc0-03dd-4c4b-992c-2181cf6648e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:29:51.848497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1279/2552] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:29:51 2022] DELETE /identity/v3/projects/15273ac34cca4da1b9375524bade1873 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:29:51.854707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5031e-c100-407f-8a19-5dc775d4a4a5 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:51.855075 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5031e-c100-407f-8a19-5dc775d4a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:51.855428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5031e-c100-407f-8a19-5dc775d4a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:51.873777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-8cd5031e-c100-407f-8a19-5dc775d4a4a5 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:29:51.875084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8cd5031e-c100-407f-8a19-5dc775d4a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:51.936509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1274/2553] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:29:51.944213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed70a1-3bc3-4d50-9469-3cb47ed1768a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:51.944569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed70a1-3bc3-4d50-9469-3cb47ed1768a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:51.944912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed70a1-3bc3-4d50-9469-3cb47ed1768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:51.963128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-faed70a1-3bc3-4d50-9469-3cb47ed1768a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:29:51.964558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-faed70a1-3bc3-4d50-9469-3cb47ed1768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:51.972481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1280/2554] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:29:51.976374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5031e-c100-407f-8a19-5dc775d4a4a5 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:51.986476 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5031e-c100-407f-8a19-5dc775d4a4a5 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:51.991060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:51.991702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:51.991994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:51.992272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:51.993714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:29:51.994026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:51.995623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:52.007570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1275/2555] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:29:52.011867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed70a1-3bc3-4d50-9469-3cb47ed1768a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:52.021213 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed70a1-3bc3-4d50-9469-3cb47ed1768a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:52.026015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:52.026661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:52.026942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:52.027216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:52.027905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:52.029899 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:52.044063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:29:52.057190 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1281/2556] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:29:52 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:29:52.061522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:52.071437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5888cb-373c-435c-b7d4-e7676ca4fbd1 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:52.127369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:52.128017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:52.128307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:52.128581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:52.129263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:52.131222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:52.137745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:29:52.151970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1276/2557] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:29:52 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:29:52.156111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:52.166729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0956e4-d850-4f33-ac45-d1c3db9ef7de admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:52.171220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:52.171866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:52.172145 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:52.172416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:52.173133 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:52.174744 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:52.185443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1282/2558] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:29:52.189138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:52.198904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8752c5-219f-4edb-ae59-98393a7e720b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:52.203491 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729107a7-71ac-425c-b1a9-58266b3721b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:52.204135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729107a7-71ac-425c-b1a9-58266b3721b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:52.204419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729107a7-71ac-425c-b1a9-58266b3721b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:52.204722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729107a7-71ac-425c-b1a9-58266b3721b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:52.205724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729107a7-71ac-425c-b1a9-58266b3721b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:52.207306 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729107a7-71ac-425c-b1a9-58266b3721b2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:52.219681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1277/2559] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:29:52.222076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:52.232477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbb455-1623-46a4-82d8-eec973187dff admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:52.237105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:52.238001 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:52.238287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:52.238562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] PATH_INFO: `/v3/projects/27d3875989324c96974b8083b7c7da47/users/e3f6a1ef7e584a57aa0bee25465fc565/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:52.253890 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3875989324c96974b8083b7c7da47, user_id=e3f6a1ef7e584a57aa0bee25465fc565, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:52.256555 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:52.268708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1283/2560] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:29:52 2022] PUT /identity/v3/projects/27d3875989324c96974b8083b7c7da47/users/e3f6a1ef7e584a57aa0bee25465fc565/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:29:52.273769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f6890-424b-4909-b68a-18079d179a0e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:52.274580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f6890-424b-4909-b68a-18079d179a0e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:52.274865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f6890-424b-4909-b68a-18079d179a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:52.293072 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2d8f6890-424b-4909-b68a-18079d179a0e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:29:52.294314 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2d8f6890-424b-4909-b68a-18079d179a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:52.351568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1278/2561] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:29:52.361749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:52.363414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:52.419604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606cbd5-bc39-458a-a723-e3b4e81e69d3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:52.423114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:52.423762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:52.424027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:52.424301 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:52.433064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:52.434500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:52.443610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1284/2562] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:29:56.501607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a90607-7fc3-4dda-93db-4a3adc10d9d8 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:56.502191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a90607-7fc3-4dda-93db-4a3adc10d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:56.502191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a90607-7fc3-4dda-93db-4a3adc10d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:56.533903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d9a90607-7fc3-4dda-93db-4a3adc10d9d8 None None] MFA Rules not processed for user `e3f6a1ef7e584a57aa0bee25465fc565`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:29:56.535122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d9a90607-7fc3-4dda-93db-4a3adc10d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:56.614065 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1279/2563] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:29:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:29:56.628381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:56.630071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:56.716804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786674-0bf0-47a1-971a-6c62c3ab8bc0 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:56.722753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:56.723548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:56.723907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:56.724268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:56.734103 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:56.735784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:56.746765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1285/2564] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:29:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:29:58.028793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:58.029288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:58.029402 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:58.053484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] MFA Rules not processed for user `e3f6a1ef7e584a57aa0bee25465fc565`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:29:58.054716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:58.062526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1280/2565] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:29:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:29:58.389754 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:58.401078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5635-d7f2-4ff6-a3ad-62653891e200 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:58.405184 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:58.406002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:58.406359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:58.406707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:58.408761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:58.420958 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:58.423115 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:58.432990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1286/2566] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:29:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:29:58.832156 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:29:58.833929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:58.926365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:29:58.932274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1d50-8652-4c12-8c4b-61fe5f5e73e8 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:29:58.939579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:29:58.940241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:58.940526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:58.940803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:58.942739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:58.956356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:29:58.957957 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:29:58.968261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1281/2567] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:29:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:30:01.190694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:30:01.200077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d22e86-1fc9-44fa-99c1-17844667e54d service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:30:01.203870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:30:01.204508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:30:01.205109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:30:01.205308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:30:01.207118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:30:01.220120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:30:01.221580 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:30:01.230384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1287/2568] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:30:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:30:08.520952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:30:08.524396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:30:08.541212 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c793ca6-4338-41eb-8f7e-03d253f46710 service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:30:08.547217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e378f0-4dc5-4b3a-a547-2f4b874c3734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:30:08.548025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e378f0-4dc5-4b3a-a547-2f4b874c3734 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:30:08.548410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e378f0-4dc5-4b3a-a547-2f4b874c3734 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:30:08.548786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e378f0-4dc5-4b3a-a547-2f4b874c3734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:30:08.551124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f5e378f0-4dc5-4b3a-a547-2f4b874c3734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:30:08.564899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e378f0-4dc5-4b3a-a547-2f4b874c3734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:30:08.566605 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e378f0-4dc5-4b3a-a547-2f4b874c3734 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:30:08.578610 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1282/2569] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:30:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:30:11.226040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:30:11.910672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:30:11.923434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215fd46-9a27-469f-8b0f-0f01bba075fe service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:30:11.928782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:30:11.929421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:30:11.929739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:30:11.930516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:30:11.932279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:30:11.944468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:30:11.946722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:30:11.957798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1288/2570] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:30:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:30:18.573507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=10 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:30:21.952741 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=6 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:31:34.872218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bcf3-6242-4e20-9ddf-3d3f89b5306a None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:34.872768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bcf3-6242-4e20-9ddf-3d3f89b5306a None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:34.872768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bcf3-6242-4e20-9ddf-3d3f89b5306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:34.901239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-fef0bcf3-6242-4e20-9ddf-3d3f89b5306a None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:31:34.902506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fef0bcf3-6242-4e20-9ddf-3d3f89b5306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:34.994617 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1283/2571] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:31:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:31:35.039243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:31:35.040672 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:35.159151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c24f-ebdc-4657-a76b-7f22e9a8a170 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:31:35.164156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:31:35.164800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:35.165084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:35.165363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:35.173537 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:31:35.175124 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:31:35.183996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1289/2572] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:31:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:31:44.992045 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=38 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:31:45.180092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=54 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:31:48.051687 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99bbd6-80c0-4922-83c6-8998d4f229b5 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:48.052152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99bbd6-80c0-4922-83c6-8998d4f229b5 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:48.052251 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99bbd6-80c0-4922-83c6-8998d4f229b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:48.079706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5e99bbd6-80c0-4922-83c6-8998d4f229b5 None None] MFA Rules not processed for user `e051cec907124f158a099e1428150e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:31:48.080889 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5e99bbd6-80c0-4922-83c6-8998d4f229b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:48.088150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1284/2573] 10.222.0.47 () {58 vars in 967 bytes} [Thu Jun 30 13:31:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:31:48.100293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:31:48.110988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39939cf4-ae20-4625-b64c-444079ed8347 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:31:48.115995 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cdd4f-b34a-47b5-9b45-0f2a3bec4215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb9bd88bce4c4c8014471d79105772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:31:48.116630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdd4f-b34a-47b5-9b45-0f2a3bec4215 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:48.116916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdd4f-b34a-47b5-9b45-0f2a3bec4215 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:48.117193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdd4f-b34a-47b5-9b45-0f2a3bec4215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:48.125151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cdd4f-b34a-47b5-9b45-0f2a3bec4215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:31:48.126755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cdd4f-b34a-47b5-9b45-0f2a3bec4215 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:31:48.134679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1290/2574] 10.222.0.47 () {60 vars in 1384 bytes} [Thu Jun 30 13:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 13:31:49.343739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99bbd6-80c0-4922-83c6-8998d4f229b5 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:31:49.359533 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99bbd6-80c0-4922-83c6-8998d4f229b5 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:31:49.366362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:31:49.367152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:49.367531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:49.367871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:49.369940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:49.384501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:31:49.386604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:31:49.390979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0763b-6d69-4216-b86b-d70e5fc7a4db None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:49.391495 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0763b-6d69-4216-b86b-d70e5fc7a4db None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:49.391606 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0763b-6d69-4216-b86b-d70e5fc7a4db None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:49.392907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1291/2575] 10.222.0.47 () {54 vars in 912 bytes} [Thu Jun 30 13:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 13:31:49.398634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ab6d-fbfe-4403-a58a-3960b9001574 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:49.398952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ab6d-fbfe-4403-a58a-3960b9001574 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:49.399214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ab6d-fbfe-4403-a58a-3960b9001574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:49.405671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1285/2576] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:31:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:31:49.467900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f9d9ab6d-fbfe-4403-a58a-3960b9001574 None None] MFA Rules not processed for user `eaaa0a5f15ee4338a750795e4abbb64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:31:49.469137 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f9d9ab6d-fbfe-4403-a58a-3960b9001574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:49.487493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1292/2577] 10.222.0.47 () {58 vars in 1009 bytes} [Thu Jun 30 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:31:49.510511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:31:49.521775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9776b0-92f9-4d1f-b7ca-d3ad9b5b1251 service nova] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:31:49.527465 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:31:49.528104 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:49.528392 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:49.528672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:49.537256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:31:49.538867 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:31:49.548521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1286/2578] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:31:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:31:51.616121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6eda-a7ea-46dc-86db-23b3ff61f880 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:51.616645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6eda-a7ea-46dc-86db-23b3ff61f880 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:51.616745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6eda-a7ea-46dc-86db-23b3ff61f880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:51.634247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-005f6eda-a7ea-46dc-86db-23b3ff61f880 None None] MFA Rules not processed for user `e3f6a1ef7e584a57aa0bee25465fc565`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:31:51.636000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-005f6eda-a7ea-46dc-86db-23b3ff61f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:51.643398 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1293/2579] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:31:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:31:59.544591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=19 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:32:01.629175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=31 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:32:20.965473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:32:20.993538 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acff18-7e9c-45d7-a2d7-13f3619dcbd9 service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:32:20.998972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df598-2519-4e63-a37f-5e6ada4bba8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:32:20.999603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df598-2519-4e63-a37f-5e6ada4bba8c service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:32:20.999887 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df598-2519-4e63-a37f-5e6ada4bba8c service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:32:21.000162 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df598-2519-4e63-a37f-5e6ada4bba8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:32:21.001936 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-683df598-2519-4e63-a37f-5e6ada4bba8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:32:21.058760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df598-2519-4e63-a37f-5e6ada4bba8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:32:21.060327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df598-2519-4e63-a37f-5e6ada4bba8c service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:32:21.069074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1287/2580] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:32:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:32:31.065009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=35 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:33:01.848590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6eda-a7ea-46dc-86db-23b3ff61f880 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:33:01.861140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6eda-a7ea-46dc-86db-23b3ff61f880 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:33:01.866063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:33:01.866705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:33:01.866993 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:33:01.867277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:33:01.869027 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:33:01.880233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:33:01.881868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:33:01.891891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1294/2581] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:33:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:33:11.887453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=6 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:33:34.617985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafaac5-9741-456d-9381-6f461b479c8d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:33:34.618499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafaac5-9741-456d-9381-6f461b479c8d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:33:34.618612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafaac5-9741-456d-9381-6f461b479c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:33:34.635663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-adafaac5-9741-456d-9381-6f461b479c8d None None] MFA Rules not processed for user `1942d9ae332b4a4d8f9f077c1eab1da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:33:34.636858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-adafaac5-9741-456d-9381-6f461b479c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:33:34.643738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1288/2582] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:33:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:33:35.108622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:33:35.129809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9c760-fa26-4df8-9571-c234136cd421 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:33:35.133312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:33:35.134016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:33:35.134380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:33:35.134655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:33:35.136511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:33:35.159569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:33:35.160991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:33:35.168941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1295/2583] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:33:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:33:44.630580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:33:45.165399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=15 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:33:59.076569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafaac5-9741-456d-9381-6f461b479c8d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:33:59.086989 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafaac5-9741-456d-9381-6f461b479c8d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:33:59.090604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:33:59.091218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:33:59.091520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:33:59.091825 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:33:59.093574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:33:59.121511 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:33:59.122945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:33:59.135788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1289/2584] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:33:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:34:00.246939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:34:00.255960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0b529-4b24-4381-bdde-acc56db3e0a6 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:34:00.259656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:34:00.260295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:34:00.260577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:34:00.260855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:34:00.263171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:00.277941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:34:00.279360 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:34:00.290245 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1296/2585] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:34:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:34:01.247546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:34:01.248941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:01.324064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca2983-de0e-4d12-b4c6-2fe36005171a service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:34:01.327874 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:34:01.329005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:34:01.329285 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:34:01.329704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:34:01.331438 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:01.395541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:34:01.396978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:34:01.406243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1290/2586] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:34:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:34:10.285356 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=6 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:34:11.401818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=68 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:34:14.944050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:34:14.952987 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415da8b-35f7-43ff-921a-c9543a4bd651 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:34:14.957110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:34:14.957772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:34:14.958058 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:34:14.958332 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:34:14.960081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:14.995357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:34:14.996778 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:34:15.016125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1297/2587] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:34:15.708708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:34:15.720923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a61a81-b134-40f4-bf5b-936fa4076f33 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:34:15.725983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:34:15.726651 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:34:15.726975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:34:15.727237 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:34:15.729010 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:15.740965 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:34:15.742596 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:34:15.755161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1291/2588] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:34:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:34:15.779651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:34:15.781088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:15.797369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7ffbb-0b74-4bd5-85e7-4cb424ddf7d9 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:34:15.802797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:34:15.803666 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:34:15.803954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:34:15.804233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] PATH_INFO: `/v3/users/1942d9ae332b4a4d8f9f077c1eab1da2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:34:15.805427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1942d9ae332b4a4d8f9f077c1eab1da2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:34:15.807392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:34:15.852584 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1942d9ae332b4a4d8f9f077c1eab1da2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:15.853237 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1942d9ae332b4a4d8f9f077c1eab1da2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:15.861144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1942d9ae332b4a4d8f9f077c1eab1da2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:15.873185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1942d9ae332b4a4d8f9f077c1eab1da2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:15.873879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1942d9ae332b4a4d8f9f077c1eab1da2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:15.886062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1298/2589] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:34:15 2022] DELETE /identity/v3/users/1942d9ae332b4a4d8f9f077c1eab1da2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:34:16.058267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:34:16.069195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c749-6708-4598-8c5b-de76f410bce2 service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:34:16.136298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:34:16.137227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:34:16.137547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:34:16.137829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] PATH_INFO: `/v3/projects/1790fa011d5a48abb986365ae449eda5` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:34:16.139014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1790fa011d5a48abb986365ae449eda5)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:34:16.141014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:34:16.188127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1790fa011d5a48abb986365ae449eda5', 'request_id': 'req-e0cb332f-0580-4c05-b324-fdff7ff870d9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:16.194105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1790fa011d5a48abb986365ae449eda5', 'request_id': 'req-e0cb332f-0580-4c05-b324-fdff7ff870d9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:16.201625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1790fa011d5a48abb986365ae449eda5', 'request_id': 'req-e0cb332f-0580-4c05-b324-fdff7ff870d9'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:16.212499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] The token cache is being invalidate because project 1790fa011d5a48abb986365ae449eda5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:34:16.212782 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:16.213413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:34:16.214983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1292/2590] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:34:16 2022] DELETE /identity/v3/projects/1790fa011d5a48abb986365ae449eda5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:34:25.882457 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:34:26.209598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:34:56.650868 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:34:56.652279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:56.728334 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a6dca-0ef3-4cd9-a1a2-428f85964966 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:34:56.789389 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:34:56.790060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:34:56.790339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:34:56.790611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:34:56.792343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:34:56.847443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:34:56.849000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:34:56.857713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1299/2591] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:34:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:35:06.853746 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=84 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:37:53.439373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:37:53.440830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:37:53.509448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb332f-0580-4c05-b324-fdff7ff870d9 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:37:53.514707 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446965ab-d665-40cf-968f-358a622c325f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:37:53.515356 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446965ab-d665-40cf-968f-358a622c325f service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:37:53.515644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446965ab-d665-40cf-968f-358a622c325f service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:37:53.515922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446965ab-d665-40cf-968f-358a622c325f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:37:53.518226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-446965ab-d665-40cf-968f-358a622c325f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:37:53.529361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446965ab-d665-40cf-968f-358a622c325f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:37:53.530954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446965ab-d665-40cf-968f-358a622c325f service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:37:53.541272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1293/2592] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:37:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:38:03.537227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=32 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:38:04.820373 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:38:04.821812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:38:04.836061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68946410-cc25-4982-8660-d7104a6e2ae0 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:38:04.841525 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:38:04.842181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:38:04.842469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:38:04.842749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:38:04.844651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:38:04.856957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:38:04.858600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:38:04.869550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1300/2593] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:38:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:38:14.864853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=6 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:39:01.150235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446965ab-d665-40cf-968f-358a622c325f service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:39:01.151649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-446965ab-d665-40cf-968f-358a622c325f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:39:01.207813 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446965ab-d665-40cf-968f-358a622c325f service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:39:01.211412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:39:01.212048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:39:01.212334 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:39:01.212608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:39:01.214416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:39:01.271676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:39:01.273093 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:39:01.282213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1294/2594] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:39:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:39:11.277846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=48 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:39:56.818546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:39:56.819954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:39:56.831624 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c532-5b21-490d-8562-3141dd60ae0f service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:39:56.835170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:39:56.835803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:39:56.836087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:39:56.836363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:39:56.844500 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:39:56.845952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:39:56.873128 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1301/2595] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:40:06.870589 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=13 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:12.875405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:12.935587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8bbbf-f582-459c-b4fa-593073ea7e50 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:12.940721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:12.941361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:12.941672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:12.941950 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:12.951211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:12.952767 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:12.962578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1295/2596] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:22.958421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=27 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:37.855446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:37.857335 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:37.951967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5f0ff-f5e1-435e-8760-38e4968513f1 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:37.955726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:37.956357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:37.956635 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:37.957012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:37.958842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:38.019883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:38.021304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:38.031345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1302/2597] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:41.045681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.060042 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe10d0e-1278-4d6e-945c-7870d19e97ce service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.066298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.067057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.067445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.067831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.070151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:41.101051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.103132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.116391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1296/2598] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:43:41.121359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.123874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:41.136725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32582b97-1403-46cf-90db-87c0d4991561 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.143134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.144981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.144981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.145166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] PATH_INFO: `/v3/users/0281a2bde51542e6af4ad2a23befe12b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.160448 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0281a2bde51542e6af4ad2a23befe12b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.162428 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.208185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0281a2bde51542e6af4ad2a23befe12b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.208831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0281a2bde51542e6af4ad2a23befe12b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.215881 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0281a2bde51542e6af4ad2a23befe12b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.216944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:41.229907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0281a2bde51542e6af4ad2a23befe12b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.230544 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db36ff9e-9365-478b-8067-131c5311c251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0281a2bde51542e6af4ad2a23befe12b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.242421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1303/2599] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:43:41 2022] DELETE /identity/v3/users/0281a2bde51542e6af4ad2a23befe12b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:41.421287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.432723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190647-aa66-4a35-8dcb-040192a2667c service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.490300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.491160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.491448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.491726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] PATH_INFO: `/v3/projects/435105e2cd5c4398aa97b27df6485c89` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.502506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=435105e2cd5c4398aa97b27df6485c89)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.504416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.548835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435105e2cd5c4398aa97b27df6485c89', 'request_id': 'req-1be69527-df83-4079-9a03-393b60c4fffe'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.555720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435105e2cd5c4398aa97b27df6485c89', 'request_id': 'req-1be69527-df83-4079-9a03-393b60c4fffe'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.563206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435105e2cd5c4398aa97b27df6485c89', 'request_id': 'req-1be69527-df83-4079-9a03-393b60c4fffe'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.573830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] The token cache is being invalidate because project 435105e2cd5c4398aa97b27df6485c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:43:41.574116 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.574796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1be69527-df83-4079-9a03-393b60c4fffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:41.576313 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1297/2600] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:43:41 2022] DELETE /identity/v3/projects/435105e2cd5c4398aa97b27df6485c89 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:41.582661 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e8bd6-a099-4694-8e51-4b3bec93bb2a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.582947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e8bd6-a099-4694-8e51-4b3bec93bb2a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.583222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e8bd6-a099-4694-8e51-4b3bec93bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.637258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3f5e8bd6-a099-4694-8e51-4b3bec93bb2a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:41.638473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3f5e8bd6-a099-4694-8e51-4b3bec93bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:41.695089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1304/2601] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:41.702631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c8401-c939-414d-b60a-2a090fc3595c None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.702922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c8401-c939-414d-b60a-2a090fc3595c None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.703205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c8401-c939-414d-b60a-2a090fc3595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.720365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5b4c8401-c939-414d-b60a-2a090fc3595c None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:41.721632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5b4c8401-c939-414d-b60a-2a090fc3595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:41.729372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1298/2602] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:41.733873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e8bd6-a099-4694-8e51-4b3bec93bb2a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.743288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e8bd6-a099-4694-8e51-4b3bec93bb2a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.748542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.749189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.749496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.749779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.750503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:43:41.750813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.752402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.763714 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1305/2603] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:43:41.767541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c8401-c939-414d-b60a-2a090fc3595c None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.776502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c8401-c939-414d-b60a-2a090fc3595c None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.781616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.782249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.782534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.782811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.783504 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.785382 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.823656 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1299/2604] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:43:41 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:43:41.824641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.834685 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f08f-0f84-4118-a1bd-4e8db59ec42b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.890060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.890717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.891002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.891277 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.891969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.893899 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.913304 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1306/2605] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:43:41 2022] POST /identity/v3/users => generated 278 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:43:41.917315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.927970 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227aada5-d5d1-4b1e-a24f-f6420f61997e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.932600 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.933228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.933547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.933827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.934545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.936132 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.946071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1300/2606] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:43:41.949621 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.959379 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c4420-6555-4756-b85d-e50d123a7cfe admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.963924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e7b52-f1eb-4be9-8b89-a0db71d7e2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:41.964566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7b52-f1eb-4be9-8b89-a0db71d7e2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:41.964849 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7b52-f1eb-4be9-8b89-a0db71d7e2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:41.965125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7b52-f1eb-4be9-8b89-a0db71d7e2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:41.966386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e7b52-f1eb-4be9-8b89-a0db71d7e2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:41.967960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e7b52-f1eb-4be9-8b89-a0db71d7e2eb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:41.978271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1307/2607] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:43:41.982785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:41.992503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161b107-752a-4c70-8c6a-d74fc622c4e6 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:41.999535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.000404 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.000686 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.000958 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] PATH_INFO: `/v3/projects/8f342da773ec4c54860b6beae5ed71dc/users/d3240785c2bc4649ade3a9a45052da35/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.004017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:42.017587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f342da773ec4c54860b6beae5ed71dc, user_id=d3240785c2bc4649ade3a9a45052da35, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.020229 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.033043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1301/2608] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:43:41 2022] PUT /identity/v3/projects/8f342da773ec4c54860b6beae5ed71dc/users/d3240785c2bc4649ade3a9a45052da35/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:42.042862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414127c-162c-4a9d-8a4a-2292b529b6a6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.043155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414127c-162c-4a9d-8a4a-2292b529b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.044077 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414127c-162c-4a9d-8a4a-2292b529b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.055817 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:42.072363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8414127c-162c-4a9d-8a4a-2292b529b6a6 None None] MFA Rules not processed for user `d3240785c2bc4649ade3a9a45052da35`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:42.073609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8414127c-162c-4a9d-8a4a-2292b529b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:42.136270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1308/2609] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:42 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:42.140801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.207583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcfe78-a306-4134-ba1a-ad65ece0bd45 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.212273 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.212924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.213207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.213513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.214210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.216648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.240823 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1302/2610] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:43:42 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:43:42.244850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414127c-162c-4a9d-8a4a-2292b529b6a6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.255782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414127c-162c-4a9d-8a4a-2292b529b6a6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.310570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.311234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.311519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.311798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.312493 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.314460 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.333541 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1309/2611] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:43:42 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:43:42.339509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.349773 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e57684-be44-46a0-9479-11252e8a0669 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.354450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.355111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.355391 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.355745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.356525 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.358189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.368778 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1303/2612] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:43:42.373175 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.383033 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b7cf7-4116-4a32-a53b-f0b40da9c59f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.388148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.389014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.389294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.389601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] PATH_INFO: `/v3/projects/f6927167d89947bc87849ef16588e0a5/users/999a869abfbc4873a2786356adbad017/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.404558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6927167d89947bc87849ef16588e0a5, user_id=999a869abfbc4873a2786356adbad017, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.407220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.419723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1310/2613] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:43:42 2022] PUT /identity/v3/projects/f6927167d89947bc87849ef16588e0a5/users/999a869abfbc4873a2786356adbad017/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:43:42.423616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.433323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198900b-b8ee-45bb-954f-3ad5dec5cbda admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.488775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a1c7-8dc4-4f84-8e1d-6f159e4e9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.489429 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a1c7-8dc4-4f84-8e1d-6f159e4e9686 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.489740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a1c7-8dc4-4f84-8e1d-6f159e4e9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.490015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a1c7-8dc4-4f84-8e1d-6f159e4e9686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.490727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a1c7-8dc4-4f84-8e1d-6f159e4e9686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.492299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a1c7-8dc4-4f84-8e1d-6f159e4e9686 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.501745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1304/2614] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:43:42.506169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.517051 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8620dc-9ce7-467f-8de1-5ac7b21590c9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.521591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.522455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.522734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.523004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] PATH_INFO: `/v3/projects/f6927167d89947bc87849ef16588e0a5/users/999a869abfbc4873a2786356adbad017/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.524930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6927167d89947bc87849ef16588e0a5, user_id=999a869abfbc4873a2786356adbad017, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.527542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.538316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1311/2615] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:43:42 2022] PUT /identity/v3/projects/f6927167d89947bc87849ef16588e0a5/users/999a869abfbc4873a2786356adbad017/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:42.549297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ee1dd-fe0e-4ad7-a801-44009c4c998d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.549616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ee1dd-fe0e-4ad7-a801-44009c4c998d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.549899 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ee1dd-fe0e-4ad7-a801-44009c4c998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.577417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-522ee1dd-fe0e-4ad7-a801-44009c4c998d None None] MFA Rules not processed for user `999a869abfbc4873a2786356adbad017`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:42.578644 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-522ee1dd-fe0e-4ad7-a801-44009c4c998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:42.620199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:42.645409 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1305/2616] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:42 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:42.656329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.658120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:42.710484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:42.714529 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5c28c-4915-47c6-9c81-4d8d93f555f4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.718931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.719912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.720195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.720466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.729391 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.730831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.740192 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1312/2617] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:42 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:42.808296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ee1dd-fe0e-4ad7-a801-44009c4c998d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:42.818665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ee1dd-fe0e-4ad7-a801-44009c4c998d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:42.822859 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890f122-a08a-47f4-9dee-009c603f0ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:42.823500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f122-a08a-47f4-9dee-009c603f0ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:42.823789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f122-a08a-47f4-9dee-009c603f0ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:42.824067 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f122-a08a-47f4-9dee-009c603f0ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:42.880171 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890f122-a08a-47f4-9dee-009c603f0ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:42.881667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890f122-a08a-47f4-9dee-009c603f0ab8 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:42.891128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1306/2618] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:42 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:43.308990 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:43.370519 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c02e2-a967-4fb2-84df-4237c6f458aa service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:43.374988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:43.375845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:43.376125 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:43.376399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] PATH_INFO: `/v3/users/d3240785c2bc4649ade3a9a45052da35` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:43.377588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3240785c2bc4649ade3a9a45052da35)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:43.379481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:43.427067 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3240785c2bc4649ade3a9a45052da35'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.427652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3240785c2bc4649ade3a9a45052da35'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.434667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3240785c2bc4649ade3a9a45052da35'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.446738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3240785c2bc4649ade3a9a45052da35'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.447371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3240785c2bc4649ade3a9a45052da35'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.459592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1313/2619] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:43:43 2022] DELETE /identity/v3/users/d3240785c2bc4649ade3a9a45052da35 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:43.468372 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:43.469238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:43.469417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:43.487704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:43.488915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:43.547012 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1307/2620] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:43.556438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:43.557866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:43.614050 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1c476-ddc5-4836-93c9-3809821d0389 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:43.617633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:43.618267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:43.618550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:43.618827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:43.628070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:43.629517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:43.639343 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1314/2621] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:43.899017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:43.900433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:43.913184 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72a80-e087-4ba3-a467-e4526d5e571d None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:43.918089 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:43.919011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:43.919332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:43.919607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] PATH_INFO: `/v3/projects/8f342da773ec4c54860b6beae5ed71dc` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:43.922009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f342da773ec4c54860b6beae5ed71dc)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:43.924195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:43.971346 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f342da773ec4c54860b6beae5ed71dc', 'request_id': 'req-89f35ffa-e426-45fc-a007-591b923b718a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.977417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f342da773ec4c54860b6beae5ed71dc', 'request_id': 'req-89f35ffa-e426-45fc-a007-591b923b718a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.984527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f342da773ec4c54860b6beae5ed71dc', 'request_id': 'req-89f35ffa-e426-45fc-a007-591b923b718a'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.994695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] The token cache is being invalidate because project 8f342da773ec4c54860b6beae5ed71dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:43:43.994981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.995629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:43.997157 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1308/2622] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:43:43 2022] DELETE /identity/v3/projects/8f342da773ec4c54860b6beae5ed71dc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:44.001101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.010520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe75e32-1c8d-4a37-a621-9c0df0be3f7d service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.019470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:44.068357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.069228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.069814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.070228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] PATH_INFO: `/v3/users/999a869abfbc4873a2786356adbad017` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.071431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999a869abfbc4873a2786356adbad017)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.073430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.118654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999a869abfbc4873a2786356adbad017'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.119310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999a869abfbc4873a2786356adbad017'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.126369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999a869abfbc4873a2786356adbad017'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.139135 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999a869abfbc4873a2786356adbad017'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.139775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-90d62e34-e296-4094-87ae-09af16751098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999a869abfbc4873a2786356adbad017'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.151652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1315/2623] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:43:44 2022] DELETE /identity/v3/users/999a869abfbc4873a2786356adbad017 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:43:44.417696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.419645 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:44.434001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f35ffa-e426-45fc-a007-591b923b718a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.435857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:44.499467 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.500255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.500531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.500801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] PATH_INFO: `/v3/projects/f6927167d89947bc87849ef16588e0a5` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.502004 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6927167d89947bc87849ef16588e0a5)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.503893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.548358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6927167d89947bc87849ef16588e0a5', 'request_id': 'req-6c0e339e-9774-48ab-971b-547f4b1c2562'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.554316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6927167d89947bc87849ef16588e0a5', 'request_id': 'req-6c0e339e-9774-48ab-971b-547f4b1c2562'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.563343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6927167d89947bc87849ef16588e0a5', 'request_id': 'req-6c0e339e-9774-48ab-971b-547f4b1c2562'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.575092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] The token cache is being invalidate because project f6927167d89947bc87849ef16588e0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:43:44.575386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.576082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6c0e339e-9774-48ab-971b-547f4b1c2562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:44.577681 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1309/2624] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:43:44 2022] DELETE /identity/v3/projects/f6927167d89947bc87849ef16588e0a5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:44.582633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95dfa4-e51f-4e83-9f9c-0d2e74dc9e2b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.583126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95dfa4-e51f-4e83-9f9c-0d2e74dc9e2b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.583244 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95dfa4-e51f-4e83-9f9c-0d2e74dc9e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.600862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4f95dfa4-e51f-4e83-9f9c-0d2e74dc9e2b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:44.602096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4f95dfa4-e51f-4e83-9f9c-0d2e74dc9e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:44.663967 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1316/2625] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:44.672553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b436158-4de5-48dc-a3d2-74b1b4846100 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.672845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b436158-4de5-48dc-a3d2-74b1b4846100 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.673124 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b436158-4de5-48dc-a3d2-74b1b4846100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.691731 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-5b436158-4de5-48dc-a3d2-74b1b4846100 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:44.692942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5b436158-4de5-48dc-a3d2-74b1b4846100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:44.701082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1310/2626] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:44.705141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95dfa4-e51f-4e83-9f9c-0d2e74dc9e2b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.714851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95dfa4-e51f-4e83-9f9c-0d2e74dc9e2b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.719474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.720123 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.720410 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.720690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.721412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:43:44.721775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.723368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.735227 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1317/2627] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:43:44.739225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b436158-4de5-48dc-a3d2-74b1b4846100 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.749080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b436158-4de5-48dc-a3d2-74b1b4846100 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.753827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.754411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.754696 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.754975 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.755673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.757574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.786223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1311/2628] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:43:44 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:43:44.787362 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.798031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de306c92-7871-4327-9e54-f25b9def2b7b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.815582 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:44.857073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.857772 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.858063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.858352 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.859062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.860964 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.879009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1318/2629] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:43:44 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:43:44.882939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.893090 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4fc7b-22f3-4481-9431-25238ebe813c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.897766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.898419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.898704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.898983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.899705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.901288 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.912554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1312/2630] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:43:44.916307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.926840 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e907e0-f430-43a8-b0af-7a1cf458254e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.931367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbca57d-936f-428e-b84b-466a6dca3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.932015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca57d-936f-428e-b84b-466a6dca3708 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.932296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca57d-936f-428e-b84b-466a6dca3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.932571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca57d-936f-428e-b84b-466a6dca3708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.933400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbca57d-936f-428e-b84b-466a6dca3708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.935043 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbca57d-936f-428e-b84b-466a6dca3708 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.945330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1319/2631] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:43:44.949420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:44.959593 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921ad3-40c7-46a3-a9c0-54bbbaa1ac3b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:44.964337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:44.965216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:44.966250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:44.966616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] PATH_INFO: `/v3/projects/91476f23dba6413da1e58c585a2fea0d/users/242239773ea5436e8d7b163f15bf319e/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:44.982570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91476f23dba6413da1e58c585a2fea0d, user_id=242239773ea5436e8d7b163f15bf319e, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:44.985188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:44.998133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1313/2632] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:43:44 2022] PUT /identity/v3/projects/91476f23dba6413da1e58c585a2fea0d/users/242239773ea5436e8d7b163f15bf319e/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:43:45.008257 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35d84-6eac-4a39-8a1c-56f76a2c307a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.008485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35d84-6eac-4a39-8a1c-56f76a2c307a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.008787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35d84-6eac-4a39-8a1c-56f76a2c307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.035641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d0f35d84-6eac-4a39-8a1c-56f76a2c307a None None] MFA Rules not processed for user `242239773ea5436e8d7b163f15bf319e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:45.036856 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d0f35d84-6eac-4a39-8a1c-56f76a2c307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:45.099683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1320/2633] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:45.104119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:45.134393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:45.166625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552ae95-9441-4ff9-a673-cc03e515897c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:45.171319 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:45.171974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.172263 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.172541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.173241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:45.175161 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:45.198938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1314/2634] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:43:45 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:43:45.203363 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f35d84-6eac-4a39-8a1c-56f76a2c307a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:45.213991 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f35d84-6eac-4a39-8a1c-56f76a2c307a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:45.268842 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:45.269634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.269914 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.270201 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.270928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:45.272879 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:45.296447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1321/2635] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:43:45 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:43:45.297728 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:45.308347 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac732fa-b8e6-4c09-922e-666e4dc27212 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:45.313163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:45.313938 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.314228 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.314512 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.315234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:45.316871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:45.328271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1315/2636] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:43:45.332258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:45.342976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee34b-d346-4de1-bd08-0631d431934c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:45.347715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:45.348590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.348874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.349179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] PATH_INFO: `/v3/projects/e3ba644eb2e041f6b0d345f8c7b11fb3/users/1636584a6d744e428f00014f05503815/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.364082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ba644eb2e041f6b0d345f8c7b11fb3, user_id=1636584a6d744e428f00014f05503815, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:45.366833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:45.369037 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:45.380168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1322/2637] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:43:45 2022] PUT /identity/v3/projects/e3ba644eb2e041f6b0d345f8c7b11fb3/users/1636584a6d744e428f00014f05503815/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:43:45.384039 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:45.394618 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ce60-ad05-4a97-bbda-99401acf7991 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:45.450265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97ab86-d186-485c-beac-5a7ce34b4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:45.450893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97ab86-d186-485c-beac-5a7ce34b4eba admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.451172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97ab86-d186-485c-beac-5a7ce34b4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.451444 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97ab86-d186-485c-beac-5a7ce34b4eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.452153 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97ab86-d186-485c-beac-5a7ce34b4eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:45.453745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97ab86-d186-485c-beac-5a7ce34b4eba admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:45.463338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1316/2638] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:43:45.468009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:45.478523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581b3b8-bdb3-43f1-a034-0136afd058ae admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:45.483141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:45.484014 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.484296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.484569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] PATH_INFO: `/v3/projects/e3ba644eb2e041f6b0d345f8c7b11fb3/users/1636584a6d744e428f00014f05503815/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.486538 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ba644eb2e041f6b0d345f8c7b11fb3, user_id=1636584a6d744e428f00014f05503815, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:45.489150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:45.499056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1323/2639] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:43:45 2022] PUT /identity/v3/projects/e3ba644eb2e041f6b0d345f8c7b11fb3/users/1636584a6d744e428f00014f05503815/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:45.556720 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e700-a268-44d0-8e45-9321ae10dd89 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.557271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e700-a268-44d0-8e45-9321ae10dd89 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.557271 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e700-a268-44d0-8e45-9321ae10dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.584518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2947e700-a268-44d0-8e45-9321ae10dd89 None None] MFA Rules not processed for user `1636584a6d744e428f00014f05503815`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:45.585766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2947e700-a268-44d0-8e45-9321ae10dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:45.651187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1317/2640] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:45.661834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:45.663531 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:45.719615 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c1952-9ba0-4000-804b-a8dc2cdada09 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:45.723232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:45.723870 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:45.724159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:45.724437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:45.779126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:45.780559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:45.789570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1324/2641] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:52.451791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e700-a268-44d0-8e45-9321ae10dd89 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:52.461508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e700-a268-44d0-8e45-9321ae10dd89 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:52.465052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:52.466256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:52.466541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:52.466815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:52.475652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:52.477074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:52.487128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1318/2642] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:54.836694 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:54.838141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:54.892947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56f3d-2465-475d-b58a-a675887fce12 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:54.896614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:54.897259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:54.897571 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:54.897850 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:54.899629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:54.947017 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:54.963610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:54.965092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:54.974837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1325/2643] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:43:58.012569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.014223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:58.034051 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767b87d-6051-45cb-9c2b-710b300c176b service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.042622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.044074 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.044388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.044664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] PATH_INFO: `/v3/users/e3f6a1ef7e584a57aa0bee25465fc565` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.053163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:58.063779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f6a1ef7e584a57aa0bee25465fc565)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.066399 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.123464 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f6a1ef7e584a57aa0bee25465fc565'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.124133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f6a1ef7e584a57aa0bee25465fc565'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.137801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f6a1ef7e584a57aa0bee25465fc565'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.138616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f6a1ef7e584a57aa0bee25465fc565'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.147240 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-b757bd0a-8946-452a-88d9-2bc1d8522fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f6a1ef7e584a57aa0bee25465fc565'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.162846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1319/2644] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:43:58 2022] DELETE /identity/v3/users/e3f6a1ef7e584a57aa0bee25465fc565 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:58.339164 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.350462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83165f45-a25b-4115-ac81-613569794696 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.407633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.408594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.408851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.409130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] PATH_INFO: `/v3/projects/27d3875989324c96974b8083b7c7da47` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.410351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d3875989324c96974b8083b7c7da47)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.412251 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.457308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3875989324c96974b8083b7c7da47', 'request_id': 'req-d73e5c27-aafb-4cc5-a136-2e53220e7b61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.464259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3875989324c96974b8083b7c7da47', 'request_id': 'req-d73e5c27-aafb-4cc5-a136-2e53220e7b61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.470977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3875989324c96974b8083b7c7da47', 'request_id': 'req-d73e5c27-aafb-4cc5-a136-2e53220e7b61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.481760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] The token cache is being invalidate because project 27d3875989324c96974b8083b7c7da47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:43:58.482044 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.482687 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d73e5c27-aafb-4cc5-a136-2e53220e7b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:43:58.484173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1326/2645] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:43:58 2022] DELETE /identity/v3/projects/27d3875989324c96974b8083b7c7da47 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:43:58.489914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dba8a-1000-4dfc-b1d0-e1e53b787054 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.490204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dba8a-1000-4dfc-b1d0-e1e53b787054 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.490479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dba8a-1000-4dfc-b1d0-e1e53b787054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.508092 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-378dba8a-1000-4dfc-b1d0-e1e53b787054 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:58.509245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-378dba8a-1000-4dfc-b1d0-e1e53b787054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:58.565715 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1320/2646] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:58.573443 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e4303-9085-4a77-9b43-4a2d8b066484 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.573765 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e4303-9085-4a77-9b43-4a2d8b066484 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.574053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e4303-9085-4a77-9b43-4a2d8b066484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.592449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-758e4303-9085-4a77-9b43-4a2d8b066484 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:58.593693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-758e4303-9085-4a77-9b43-4a2d8b066484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:58.601657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1327/2647] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:43:58.605435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dba8a-1000-4dfc-b1d0-e1e53b787054 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.615551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dba8a-1000-4dfc-b1d0-e1e53b787054 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.620016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.620655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.620934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.621205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.621979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:43:58.622284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.623856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.635131 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1321/2648] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:43:58.639605 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e4303-9085-4a77-9b43-4a2d8b066484 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.648773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e4303-9085-4a77-9b43-4a2d8b066484 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.653973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.654609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.654896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.655176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.655876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.657795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.681785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1328/2649] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:43:58 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:43:58.685870 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.695882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0c7ad-d103-401e-8ec9-af098292740a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.750921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.751569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.751852 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.752127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.752814 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.754730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.761158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:58.776622 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1322/2650] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:43:58 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:43:58.781188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.791446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a897d-7e0f-4eda-9629-3ac05c317c9c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.796160 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.796814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.797119 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.797413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.798158 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.799740 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.811083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1329/2651] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:43:58.814802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.825445 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6a66-d68d-4415-b55b-0bcb25bdffc4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.830055 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6907-d02f-4094-851b-f3c098adaba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.830702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6907-d02f-4094-851b-f3c098adaba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.830987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6907-d02f-4094-851b-f3c098adaba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.831266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6907-d02f-4094-851b-f3c098adaba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.831984 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6907-d02f-4094-851b-f3c098adaba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.833591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6907-d02f-4094-851b-f3c098adaba1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.843871 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1323/2652] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:43:58.847735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.857607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218056-823e-4ea1-b874-94ecf9824f9b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:58.862101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:58.862960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.863241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.863518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] PATH_INFO: `/v3/projects/cfa2a7973f13461cb930cc0cd8d3fc8a/users/3c45d1f824304bee88d8bd04a2d106e4/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.877378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa2a7973f13461cb930cc0cd8d3fc8a, user_id=3c45d1f824304bee88d8bd04a2d106e4, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:58.880006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:58.892899 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1330/2653] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:43:58 2022] PUT /identity/v3/projects/cfa2a7973f13461cb930cc0cd8d3fc8a/users/3c45d1f824304bee88d8bd04a2d106e4/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:43:58.897862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49de20-3b2c-4b44-8eec-669d4139f568 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:58.898173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49de20-3b2c-4b44-8eec-669d4139f568 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:58.898460 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49de20-3b2c-4b44-8eec-669d4139f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:58.916843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-fc49de20-3b2c-4b44-8eec-669d4139f568 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:43:58.918061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-fc49de20-3b2c-4b44-8eec-669d4139f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:58.978738 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1324/2654] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:43:58.988438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:43:58.990298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:43:59.004181 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:43:59.052909 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c137-98d4-4a24-97bc-bd86c5687191 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:43:59.056574 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:43:59.057215 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:43:59.057534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:43:59.057815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:43:59.067273 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:43:59.068689 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:43:59.078997 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1331/2655] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:02.995706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3825-2abe-4826-91ea-bf86c9e7b637 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:02.996749 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3825-2abe-4826-91ea-bf86c9e7b637 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:02.997008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3825-2abe-4826-91ea-bf86c9e7b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:03.034183 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-3a4f3825-2abe-4826-91ea-bf86c9e7b637 None None] MFA Rules not processed for user `3c45d1f824304bee88d8bd04a2d106e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:03.035508 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-3a4f3825-2abe-4826-91ea-bf86c9e7b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:03.110213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1325/2656] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:44:03.125289 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:03.127699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:03.245838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab544-6df1-48ec-bff9-46d141d8ab05 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:03.252534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:03.253074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:03.253357 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:03.253676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:03.262447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:03.264041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:03.275382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1332/2657] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:04.576792 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:04.577663 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:04.577946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:04.596469 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] MFA Rules not processed for user `3c45d1f824304bee88d8bd04a2d106e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:04.597700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:04.607167 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1326/2658] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:04.645070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:04.647152 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:04.739178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3677f2-da3e-4e3f-9245-00c7afeb179c service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:04.743172 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca9f55fa22844a31ba5bc9bff04ab67d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:04.743887 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:04.744253 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:04.744601 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:04.746566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:04.760466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:04.772348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:04.774080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:04.792458 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1333/2659] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:05.102956 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:05.104428 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:05.119597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873af7-5188-4703-80ba-2ba0d6f33a1e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:05.124502 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:05.126594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:05.126594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:05.126594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:05.128376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:05.139934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:05.141570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:05.150022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1327/2660] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:05.512300 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:05.518863 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:05.520322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:05.522588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847edf8-200f-43a7-ab6d-9cd837342175 service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:05.526962 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:05.527776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:05.528188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:05.528539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:05.530401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:05.550908 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:05.552904 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:05.566110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1334/2661] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:05.586268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:05.611601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d500b2-c86c-443d-9ccf-a07c1d9dcbc8 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:05.623972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:05.624657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:05.624944 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:05.625222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:05.627097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:05.639785 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:05.641758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:05.653175 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1328/2662] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:44:10.886526 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:10.895895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eaf44-d770-4b55-a628-d334f2028ec8 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:10.899729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:10.900297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:10.900585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:10.900867 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:10.902723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:10.913314 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:10.914889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:10.924511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1335/2663] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:11.634340 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:11.651866 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6791-8b20-41ce-9d25-97b71f1f447b service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:11.658144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfc0b1-f7ce-4915-8e65-7b536abded34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:11.658904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfc0b1-f7ce-4915-8e65-7b536abded34 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:11.659254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfc0b1-f7ce-4915-8e65-7b536abded34 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:11.660173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfc0b1-f7ce-4915-8e65-7b536abded34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:11.662431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d6cfc0b1-f7ce-4915-8e65-7b536abded34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:11.676735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfc0b1-f7ce-4915-8e65-7b536abded34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:11.678730 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfc0b1-f7ce-4915-8e65-7b536abded34 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:11.695027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1329/2664] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:20.920299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=14 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:21.689327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=16 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:22.588351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:22.590331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:22.634604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b350-8e25-481b-9526-44c6f6564e0c service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:22.639650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:22.640517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:22.640799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:22.641075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] PATH_INFO: `/v3/users/242239773ea5436e8d7b163f15bf319e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:22.642286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242239773ea5436e8d7b163f15bf319e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:22.644185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:22.688243 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242239773ea5436e8d7b163f15bf319e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:22.688882 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242239773ea5436e8d7b163f15bf319e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:22.696222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242239773ea5436e8d7b163f15bf319e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:22.708786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242239773ea5436e8d7b163f15bf319e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:22.709419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242239773ea5436e8d7b163f15bf319e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:22.721969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1336/2665] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:22 2022] DELETE /identity/v3/users/242239773ea5436e8d7b163f15bf319e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:22.726522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515debcc-f47f-475b-b6df-f66874500039 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:22.726999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515debcc-f47f-475b-b6df-f66874500039 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:22.727122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515debcc-f47f-475b-b6df-f66874500039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:22.743655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-515debcc-f47f-475b-b6df-f66874500039 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:22.744845 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-515debcc-f47f-475b-b6df-f66874500039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:22.803419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1330/2666] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:22.812896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:22.814550 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:22.871662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0651-4602-4e77-b31a-1d31a77f5015 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:22.875527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:22.876168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:22.876449 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:22.876724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:22.885989 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:22.887872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:22.897941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1337/2667] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:23.196130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515debcc-f47f-475b-b6df-f66874500039 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:23.197793 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-515debcc-f47f-475b-b6df-f66874500039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:23.211574 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515debcc-f47f-475b-b6df-f66874500039 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:23.217079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:23.218060 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:23.218568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:23.218915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] PATH_INFO: `/v3/projects/91476f23dba6413da1e58c585a2fea0d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:23.220230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91476f23dba6413da1e58c585a2fea0d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:23.222311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:23.275886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91476f23dba6413da1e58c585a2fea0d', 'request_id': 'req-eaea1754-befb-4eec-98e9-42581b4f5325'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.282589 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91476f23dba6413da1e58c585a2fea0d', 'request_id': 'req-eaea1754-befb-4eec-98e9-42581b4f5325'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.292151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91476f23dba6413da1e58c585a2fea0d', 'request_id': 'req-eaea1754-befb-4eec-98e9-42581b4f5325'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.305035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] The token cache is being invalidate because project 91476f23dba6413da1e58c585a2fea0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:23.305485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.306407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.306861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:23.311716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1331/2668] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:23 2022] DELETE /identity/v3/projects/91476f23dba6413da1e58c585a2fea0d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:23.311833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:23.312942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:23.314704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:23.370664 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:23.394456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1754-befb-4eec-98e9-42581b4f5325 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:23.399548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:23.400420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:23.400706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:23.400986 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] PATH_INFO: `/v3/users/1636584a6d744e428f00014f05503815` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:23.402218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1636584a6d744e428f00014f05503815)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:23.403114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693eb9-faa2-4a86-bc90-ec032fe8b86d service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:23.404125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:23.435176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:23.456297 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1636584a6d744e428f00014f05503815'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.457082 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1636584a6d744e428f00014f05503815'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.468173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0afe5-2932-4bc3-a8b0-4d29e4a22c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:23.468819 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0afe5-2932-4bc3-a8b0-4d29e4a22c9a service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:23.469100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0afe5-2932-4bc3-a8b0-4d29e4a22c9a service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:23.469238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1636584a6d744e428f00014f05503815'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.469368 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0afe5-2932-4bc3-a8b0-4d29e4a22c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:23.469802 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1636584a6d744e428f00014f05503815'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.471138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a9e0afe5-2932-4bc3-a8b0-4d29e4a22c9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:23.477831 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1636584a6d744e428f00014f05503815'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.484092 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0afe5-2932-4bc3-a8b0-4d29e4a22c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:23.485692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0afe5-2932-4bc3-a8b0-4d29e4a22c9a service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:23.491163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1332/2669] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:23 2022] DELETE /identity/v3/users/1636584a6d744e428f00014f05503815 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:23.501259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1338/2670] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:44:23.821018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:23.822621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:23.889524 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bbc4e-7b37-4d14-a741-3f5a11b0569b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:23.894011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:23.894864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:23.895144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:23.895415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] PATH_INFO: `/v3/projects/e3ba644eb2e041f6b0d345f8c7b11fb3` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:23.896628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ba644eb2e041f6b0d345f8c7b11fb3)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:23.898572 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:23.943265 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ba644eb2e041f6b0d345f8c7b11fb3', 'request_id': 'req-c57d4bcd-f84c-4e0e-a698-305226ac3abe'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.949309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ba644eb2e041f6b0d345f8c7b11fb3', 'request_id': 'req-c57d4bcd-f84c-4e0e-a698-305226ac3abe'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.956705 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ba644eb2e041f6b0d345f8c7b11fb3', 'request_id': 'req-c57d4bcd-f84c-4e0e-a698-305226ac3abe'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.967204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] The token cache is being invalidate because project e3ba644eb2e041f6b0d345f8c7b11fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:23.967485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.968095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c57d4bcd-f84c-4e0e-a698-305226ac3abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:23.969611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1333/2671] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:23 2022] DELETE /identity/v3/projects/e3ba644eb2e041f6b0d345f8c7b11fb3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:23.974607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6cde-cb00-42e4-802e-7760557c7ad7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:23.975100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6cde-cb00-42e4-802e-7760557c7ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:23.975247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6cde-cb00-42e4-802e-7760557c7ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:23.993004 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-790d6cde-cb00-42e4-802e-7760557c7ad7 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:23.994520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-790d6cde-cb00-42e4-802e-7760557c7ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:24.054056 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1339/2672] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:24.062053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2bbc-d2db-4b5c-a6fa-73c7e8ca4673 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.062408 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2bbc-d2db-4b5c-a6fa-73c7e8ca4673 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.062692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2bbc-d2db-4b5c-a6fa-73c7e8ca4673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.081673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7dbf2bbc-d2db-4b5c-a6fa-73c7e8ca4673 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:24.083029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7dbf2bbc-d2db-4b5c-a6fa-73c7e8ca4673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:24.091191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1334/2673] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:24.095220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d6cde-cb00-42e4-802e-7760557c7ad7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.105024 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d6cde-cb00-42e4-802e-7760557c7ad7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.110814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.111488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.111775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.112047 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.112779 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:44:24.113090 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.114734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.127474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1340/2674] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:44:24.131878 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2bbc-d2db-4b5c-a6fa-73c7e8ca4673 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.142126 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2bbc-d2db-4b5c-a6fa-73c7e8ca4673 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.147177 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.147838 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.148122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.148517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.149230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.151210 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.176606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1335/2675] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:24 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:44:24.180512 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.190994 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386fad1-c2e7-49ea-a650-662c5bf02f49 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.242308 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=100 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:24.249156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.249877 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.250267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.250548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.251268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.253151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.271844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1341/2676] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:24 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:24.275827 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.282620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:24.287479 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaffded-0e35-4c9a-bab4-993363af8add admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.294634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.295535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.296013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.296299 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.297071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.298820 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.310223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1336/2677] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:24.314203 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.324255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51475d6d-51d6-469b-9bdf-ff71324fd95a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.328926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b47e0-9c6f-43fd-8074-0dc3eefe2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.329607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b47e0-9c6f-43fd-8074-0dc3eefe2d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.329896 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b47e0-9c6f-43fd-8074-0dc3eefe2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.330176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b47e0-9c6f-43fd-8074-0dc3eefe2d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.330926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b47e0-9c6f-43fd-8074-0dc3eefe2d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.332506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b47e0-9c6f-43fd-8074-0dc3eefe2d1d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.343088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1342/2678] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:24.347312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.358091 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0efe-731f-4e81-b3a1-78d6f85f4ceb admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.362678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.363558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.363846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.364125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] PATH_INFO: `/v3/projects/26edf8704f4f48a8830494b2f26c006f/users/fa4d40d3bd374f00bc55b4a54789e7f5/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.380423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=26edf8704f4f48a8830494b2f26c006f, user_id=fa4d40d3bd374f00bc55b4a54789e7f5, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.383098 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.395655 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1337/2679] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:24 2022] PUT /identity/v3/projects/26edf8704f4f48a8830494b2f26c006f/users/fa4d40d3bd374f00bc55b4a54789e7f5/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:24.406876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd1a39-c638-4e9d-8b96-151dd3c10456 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.407171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd1a39-c638-4e9d-8b96-151dd3c10456 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.407452 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd1a39-c638-4e9d-8b96-151dd3c10456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.434216 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f9dd1a39-c638-4e9d-8b96-151dd3c10456 None None] MFA Rules not processed for user `fa4d40d3bd374f00bc55b4a54789e7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:24.435417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f9dd1a39-c638-4e9d-8b96-151dd3c10456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:24.498260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1343/2680] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:24.502530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.562839 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f0027-5300-468f-b81d-36daf12966fe admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.567760 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.568423 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.568702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.568972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.570064 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.571849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.596695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1338/2681] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:24 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:44:24.601030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd1a39-c638-4e9d-8b96-151dd3c10456 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.612455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd1a39-c638-4e9d-8b96-151dd3c10456 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.668803 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.669516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.669804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.670084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.670812 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.672722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.691998 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1344/2682] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:24 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:24.696142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.706743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689663fc-c934-49e8-9a88-7c5b2dbd7488 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.711407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.712057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.712335 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.712608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.713323 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.715435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.725673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1339/2683] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:24.729565 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.740075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6e451-4f9a-43dc-9109-d818ebc7edb4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.744657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.745553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.745869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.746148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] PATH_INFO: `/v3/projects/767b9268d644452c8fa623cbc49414c7/users/e5d5a75d750a44e8900cfc3fff2870cb/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.760873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=767b9268d644452c8fa623cbc49414c7, user_id=e5d5a75d750a44e8900cfc3fff2870cb, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.763489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.776423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1345/2684] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:24 2022] PUT /identity/v3/projects/767b9268d644452c8fa623cbc49414c7/users/e5d5a75d750a44e8900cfc3fff2870cb/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:24.780790 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.790695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e47bd-151d-44c5-b43e-8c6cb4c41b15 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.846264 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec72a6-0f5c-43e4-a874-f4201a84094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.846921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec72a6-0f5c-43e4-a874-f4201a84094a admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.847205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec72a6-0f5c-43e4-a874-f4201a84094a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.847483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec72a6-0f5c-43e4-a874-f4201a84094a admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.848193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec72a6-0f5c-43e4-a874-f4201a84094a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.849797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec72a6-0f5c-43e4-a874-f4201a84094a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.859830 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1340/2685] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:24.863859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:24.873857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219f1ca-f7ca-465b-8cf4-401931d584ad admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:24.878372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:24.879234 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.879511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.879781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] PATH_INFO: `/v3/projects/767b9268d644452c8fa623cbc49414c7/users/e5d5a75d750a44e8900cfc3fff2870cb/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.881788 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767b9268d644452c8fa623cbc49414c7, user_id=e5d5a75d750a44e8900cfc3fff2870cb, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:24.884370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:24.894833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1346/2686] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:24 2022] PUT /identity/v3/projects/767b9268d644452c8fa623cbc49414c7/users/e5d5a75d750a44e8900cfc3fff2870cb/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:24.904968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:24.905257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:24.905560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:24.931332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] MFA Rules not processed for user `e5d5a75d750a44e8900cfc3fff2870cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:24.932540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:24.961522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:25.000685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1341/2687] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:25.011830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:25.013515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:25.035713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:25.092361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c6cd-02d0-4202-84ec-d5e3b8053cc5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:25.096161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:25.096804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:25.097089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:25.097366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:25.108007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:25.109444 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:25.119153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1347/2688] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:25.163591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:25.165077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:25.177857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4bef-a497-4520-a193-58f3add388f6 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:25.181500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a0816-1494-43dd-a35a-9c5b6c70f3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:25.182147 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a0816-1494-43dd-a35a-9c5b6c70f3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:25.182433 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a0816-1494-43dd-a35a-9c5b6c70f3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:25.182714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a0816-1494-43dd-a35a-9c5b6c70f3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:25.244137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a0816-1494-43dd-a35a-9c5b6c70f3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:25.249563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a0816-1494-43dd-a35a-9c5b6c70f3a8 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:25.259138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1342/2689] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:28.485818 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:28.549501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518a339-7d6f-486f-9d61-6b70b0a0be87 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:28.553950 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:28.554825 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:28.555109 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:28.555386 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] PATH_INFO: `/v3/users/fa4d40d3bd374f00bc55b4a54789e7f5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:28.556629 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4d40d3bd374f00bc55b4a54789e7f5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:28.559299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:28.613757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4d40d3bd374f00bc55b4a54789e7f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:28.614411 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4d40d3bd374f00bc55b4a54789e7f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:28.623324 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4d40d3bd374f00bc55b4a54789e7f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:28.635864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4d40d3bd374f00bc55b4a54789e7f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:28.637144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4d40d3bd374f00bc55b4a54789e7f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:28.649897 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1348/2690] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:28 2022] DELETE /identity/v3/users/fa4d40d3bd374f00bc55b4a54789e7f5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:44:28.654165 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:28.654646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:28.654766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:28.671931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:28.673127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:28.731389 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1343/2691] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:28.740833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:28.742288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:28.763716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:28.799645 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7826ee-faf7-4a53-a116-dda3495ff349 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:28.803415 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:28.804061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:28.804346 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:28.804623 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:28.814353 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:28.815781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:28.825577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1349/2692] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:29.087550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:29.089105 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:29.104585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d34e-ee5a-43c4-ad11-c3246ac34438 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:29.110424 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:29.111450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:29.111746 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:29.112560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] PATH_INFO: `/v3/projects/26edf8704f4f48a8830494b2f26c006f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:29.113216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26edf8704f4f48a8830494b2f26c006f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:29.115155 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:29.161665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26edf8704f4f48a8830494b2f26c006f', 'request_id': 'req-12c2833c-7398-4ac5-86dd-ac0222ce62d4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.168262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26edf8704f4f48a8830494b2f26c006f', 'request_id': 'req-12c2833c-7398-4ac5-86dd-ac0222ce62d4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.171808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:29.176601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26edf8704f4f48a8830494b2f26c006f', 'request_id': 'req-12c2833c-7398-4ac5-86dd-ac0222ce62d4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.187968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] The token cache is being invalidate because project 26edf8704f4f48a8830494b2f26c006f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:29.188255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.188913 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.190473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1344/2693] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:29 2022] DELETE /identity/v3/projects/26edf8704f4f48a8830494b2f26c006f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:29.194557 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:29.204034 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ce270-baa0-4d23-a968-985690dfc02c service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:29.259937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:29.260796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:29.261084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:29.261366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] PATH_INFO: `/v3/users/e5d5a75d750a44e8900cfc3fff2870cb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:29.262575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d5a75d750a44e8900cfc3fff2870cb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:29.264488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:29.310414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d5a75d750a44e8900cfc3fff2870cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.311057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d5a75d750a44e8900cfc3fff2870cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.317931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d5a75d750a44e8900cfc3fff2870cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.330258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d5a75d750a44e8900cfc3fff2870cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.330954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ad17e7be-1e51-48ab-b37d-1488035a3b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d5a75d750a44e8900cfc3fff2870cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.343910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1350/2694] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:29 2022] DELETE /identity/v3/users/e5d5a75d750a44e8900cfc3fff2870cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:29.613122 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:29.614581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:29.628353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2833c-7398-4ac5-86dd-ac0222ce62d4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:29.686294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:29.687151 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:29.687431 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:29.687702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] PATH_INFO: `/v3/projects/767b9268d644452c8fa623cbc49414c7` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:29.688847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767b9268d644452c8fa623cbc49414c7)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:29.690779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:29.736239 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767b9268d644452c8fa623cbc49414c7', 'request_id': 'req-c5ce7965-116c-4b21-a54e-056479ad29c7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.742188 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767b9268d644452c8fa623cbc49414c7', 'request_id': 'req-c5ce7965-116c-4b21-a54e-056479ad29c7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.749169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767b9268d644452c8fa623cbc49414c7', 'request_id': 'req-c5ce7965-116c-4b21-a54e-056479ad29c7'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.759378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] The token cache is being invalidate because project 767b9268d644452c8fa623cbc49414c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:29.759657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.760294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c5ce7965-116c-4b21-a54e-056479ad29c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:29.762417 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1345/2695] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:29 2022] DELETE /identity/v3/projects/767b9268d644452c8fa623cbc49414c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:29.768073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f7ede-f5c7-45ab-9657-10e21f957707 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:29.768560 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f7ede-f5c7-45ab-9657-10e21f957707 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:29.768690 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f7ede-f5c7-45ab-9657-10e21f957707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:29.787937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1e9f7ede-f5c7-45ab-9657-10e21f957707 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:29.789116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1e9f7ede-f5c7-45ab-9657-10e21f957707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:29.827498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:29.849977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1351/2696] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:29.858683 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb2bd2-ce14-43f9-9db4-3dd348b87a75 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:29.858908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb2bd2-ce14-43f9-9db4-3dd348b87a75 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:29.859182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb2bd2-ce14-43f9-9db4-3dd348b87a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:29.877344 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-30bb2bd2-ce14-43f9-9db4-3dd348b87a75 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:29.878556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-30bb2bd2-ce14-43f9-9db4-3dd348b87a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:29.887217 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1346/2697] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:29.891151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f7ede-f5c7-45ab-9657-10e21f957707 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:29.900900 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f7ede-f5c7-45ab-9657-10e21f957707 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:29.905351 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:29.906007 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:29.906290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:29.906562 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:29.907279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:44:29.907583 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:29.909186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:29.920467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1352/2698] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:44:29.924419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb2bd2-ce14-43f9-9db4-3dd348b87a75 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:29.934137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb2bd2-ce14-43f9-9db4-3dd348b87a75 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:29.938911 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:29.939664 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:29.939951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:29.940227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:29.940926 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:29.942848 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:29.968522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1347/2699] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:29 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:29.972588 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:29.983162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74399f34-e06d-49ef-b296-72e2efb1a154 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.037886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.038554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.038839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.039118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.039815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.041749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.061613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1353/2700] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:29 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:30.065620 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.076331 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060aaf18-c4f3-4287-8914-062f813d4ab5 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.081029 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.081719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.081999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.082274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.082988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.084577 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.096501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1348/2701] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:30.099980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.110655 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713abe15-eace-4234-b21c-262edb8b3dd4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.115177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeae00-9d54-4ddd-9dcf-986410825964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.115827 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeae00-9d54-4ddd-9dcf-986410825964 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.116110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeae00-9d54-4ddd-9dcf-986410825964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.116384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeae00-9d54-4ddd-9dcf-986410825964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.117130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeae00-9d54-4ddd-9dcf-986410825964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.118745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeae00-9d54-4ddd-9dcf-986410825964 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.128427 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1354/2702] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:30.132320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.142631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16919-47de-4e2e-a5f6-008c3b7b7995 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.147230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.148099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.148381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.148657 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] PATH_INFO: `/v3/projects/4ff9197617af48c4ba36863a3e8558ae/users/a33c993f50f940c3af1b7f21d3e4305b/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.163869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff9197617af48c4ba36863a3e8558ae, user_id=a33c993f50f940c3af1b7f21d3e4305b, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.166547 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.187413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1349/2703] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:30 2022] PUT /identity/v3/projects/4ff9197617af48c4ba36863a3e8558ae/users/a33c993f50f940c3af1b7f21d3e4305b/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:30.200845 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f53470-5ff8-432e-9aed-a701ee1ae44c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.201182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f53470-5ff8-432e-9aed-a701ee1ae44c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.201447 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f53470-5ff8-432e-9aed-a701ee1ae44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.227640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-70f53470-5ff8-432e-9aed-a701ee1ae44c None None] MFA Rules not processed for user `a33c993f50f940c3af1b7f21d3e4305b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:30.228835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-70f53470-5ff8-432e-9aed-a701ee1ae44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:30.291921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1355/2704] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:30.296330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.309369 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:30.360541 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3fff5-8145-4326-8aa5-21f0030fee68 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.365191 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.365821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.366103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.366378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.367063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.368934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.393695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1350/2705] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:30 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:30.397743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f53470-5ff8-432e-9aed-a701ee1ae44c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.409402 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f53470-5ff8-432e-9aed-a701ee1ae44c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.440983 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:30.465425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.466173 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.466453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.466725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.467400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.469288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.488309 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1356/2706] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:30 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:30.492226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.502543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615b4a7-25f9-4763-8436-277ebdbdcdd4 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.507079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.507725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.508026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.508300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.509017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.510676 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.521951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1351/2707] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:30.525712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.536370 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf6a4-4574-45a1-ae7d-18530a715a6e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.541035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af890b4-60ae-4aa4-a114-4d6867e4fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.541718 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af890b4-60ae-4aa4-a114-4d6867e4fef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.542012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af890b4-60ae-4aa4-a114-4d6867e4fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.542288 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af890b4-60ae-4aa4-a114-4d6867e4fef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.543011 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af890b4-60ae-4aa4-a114-4d6867e4fef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.544596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af890b4-60ae-4aa4-a114-4d6867e4fef3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.554312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1357/2708] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:30.558791 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.568437 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c0997-5f5a-49d5-a46a-215d9973968e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.573530 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.575050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.575327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.575597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] PATH_INFO: `/v3/projects/403b5be169b44936951f7530348fc0a4/users/1b9d4b82703a4c9a84cbdfd5f3a9c0d0/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.590380 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=403b5be169b44936951f7530348fc0a4, user_id=1b9d4b82703a4c9a84cbdfd5f3a9c0d0, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.592977 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.606499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1352/2709] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:30 2022] PUT /identity/v3/projects/403b5be169b44936951f7530348fc0a4/users/1b9d4b82703a4c9a84cbdfd5f3a9c0d0/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:30.616855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b6c0a-075b-4460-8af6-f5b4630525be None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.617088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b6c0a-075b-4460-8af6-f5b4630525be None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.617400 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b6c0a-075b-4460-8af6-f5b4630525be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.642975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-490b6c0a-075b-4460-8af6-f5b4630525be None None] MFA Rules not processed for user `1b9d4b82703a4c9a84cbdfd5f3a9c0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:30.644176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-490b6c0a-075b-4460-8af6-f5b4630525be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:30.708189 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1358/2710] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:30.712716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.771864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b434-ad03-4a53-8c29-19bb903cfe4f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.776411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.777052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.777332 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.777642 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.778320 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.780190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.805376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1353/2711] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:30 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:30.810204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b6c0a-075b-4460-8af6-f5b4630525be None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.821120 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b6c0a-075b-4460-8af6-f5b4630525be None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.876329 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.876917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.877199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.877492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.878178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.880061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.899860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1359/2712] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:30 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:30.904374 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.915080 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb19e6-63f9-44ed-a532-eaa33ac1b16d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.919739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.920388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.920670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.920947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.921698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.923280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.934370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1354/2713] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:30.938375 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.948464 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3963-c3d2-4611-9204-c8f50273bdb2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:30.953430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:30.954326 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:30.954606 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:30.954878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] PATH_INFO: `/v3/projects/aa83b0618dc94bf48106854ba8864a8f/users/5a6dac9c0f1f4de589396190f1a9dac4/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:30.969630 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa83b0618dc94bf48106854ba8864a8f, user_id=5a6dac9c0f1f4de589396190f1a9dac4, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:30.972231 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:30.984517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1360/2714] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:30 2022] PUT /identity/v3/projects/aa83b0618dc94bf48106854ba8864a8f/users/5a6dac9c0f1f4de589396190f1a9dac4/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:30.988354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:30.998352 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081510f6-4479-4d68-84c4-ae48d1f67725 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:31.031650 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:31.054459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939204f8-8f2c-4b1e-8aba-868475ac652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:31.055114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939204f8-8f2c-4b1e-8aba-868475ac652f admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:31.055396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939204f8-8f2c-4b1e-8aba-868475ac652f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:31.055671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939204f8-8f2c-4b1e-8aba-868475ac652f admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:31.056383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939204f8-8f2c-4b1e-8aba-868475ac652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:31.057988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939204f8-8f2c-4b1e-8aba-868475ac652f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:31.067483 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1355/2715] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:31.071798 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:31.082547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26d381-f3fd-4e86-98ec-b51b85d2e5be admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:31.087242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:31.088113 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:31.088398 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:31.088679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] PATH_INFO: `/v3/projects/aa83b0618dc94bf48106854ba8864a8f/users/5a6dac9c0f1f4de589396190f1a9dac4/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:31.091325 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa83b0618dc94bf48106854ba8864a8f, user_id=5a6dac9c0f1f4de589396190f1a9dac4, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:31.094002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:31.099392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:31.105501 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1361/2716] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:31 2022] PUT /identity/v3/projects/aa83b0618dc94bf48106854ba8864a8f/users/5a6dac9c0f1f4de589396190f1a9dac4/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:44:31.116206 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:31.116501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:31.116787 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:31.143226 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] MFA Rules not processed for user `5a6dac9c0f1f4de589396190f1a9dac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:31.144361 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:31.211531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1356/2717] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:31.222669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:31.224364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:31.280069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d188d-b5f5-4e2f-9252-340a64d76431 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:31.283683 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:31.284316 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:31.284777 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:31.285038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:31.294657 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:31.296076 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:31.305281 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1362/2718] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:31.344159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:31.345597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:31.358554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff551-4c61-4ef3-a934-edff249b520f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:31.362427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb79aa8-478e-47db-9dc5-47aaf51bc620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:31.363097 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb79aa8-478e-47db-9dc5-47aaf51bc620 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:31.363384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb79aa8-478e-47db-9dc5-47aaf51bc620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:31.363666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb79aa8-478e-47db-9dc5-47aaf51bc620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:31.419671 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb79aa8-478e-47db-9dc5-47aaf51bc620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:31.421035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb79aa8-478e-47db-9dc5-47aaf51bc620 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:31.429974 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1357/2719] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:34.255261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:34.317019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce648-1881-4a1e-a3d9-1570ea00edfe service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:34.321947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:34.322863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:34.323141 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:34.323425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] PATH_INFO: `/v3/users/a33c993f50f940c3af1b7f21d3e4305b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:34.325133 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33c993f50f940c3af1b7f21d3e4305b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:34.327071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:34.374564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33c993f50f940c3af1b7f21d3e4305b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.375212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33c993f50f940c3af1b7f21d3e4305b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.382359 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33c993f50f940c3af1b7f21d3e4305b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.395071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33c993f50f940c3af1b7f21d3e4305b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.395698 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33c993f50f940c3af1b7f21d3e4305b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.407595 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1363/2720] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:34 2022] DELETE /identity/v3/users/a33c993f50f940c3af1b7f21d3e4305b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:34.412227 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:34.412706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:34.412811 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:34.429725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:34.430843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:34.480981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:34.490375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1358/2721] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:44:34.499905 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:34.501364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:34.522699 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:34.559546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a368f8-9143-4d9b-93e9-f1bd8c9701b3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:34.563206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:34.563860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:34.564171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:34.564523 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:34.574834 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:34.576305 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:34.585726 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1364/2722] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:34.853118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:34.854714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:34.868186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4b9f-1f37-4702-a06b-0382c3591886 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:34.872809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:34.873713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:34.873999 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:34.874274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] PATH_INFO: `/v3/projects/4ff9197617af48c4ba36863a3e8558ae` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:34.875466 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff9197617af48c4ba36863a3e8558ae)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:34.877480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:34.925032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff9197617af48c4ba36863a3e8558ae', 'request_id': 'req-343e0b90-6226-410d-8419-4db019a15b83'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.931063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff9197617af48c4ba36863a3e8558ae', 'request_id': 'req-343e0b90-6226-410d-8419-4db019a15b83'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.938311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff9197617af48c4ba36863a3e8558ae', 'request_id': 'req-343e0b90-6226-410d-8419-4db019a15b83'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.949328 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] The token cache is being invalidate because project 4ff9197617af48c4ba36863a3e8558ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:34.949630 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.950243 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:34.951772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1359/2723] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:34 2022] DELETE /identity/v3/projects/4ff9197617af48c4ba36863a3e8558ae => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:34.955801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:34.965835 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4b0dc-34a1-4677-9e11-d3cb75703887 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:35.019339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:35.020195 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:35.020476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:35.020749 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] PATH_INFO: `/v3/users/1b9d4b82703a4c9a84cbdfd5f3a9c0d0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:35.021943 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9d4b82703a4c9a84cbdfd5f3a9c0d0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:35.023829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:35.068074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9d4b82703a4c9a84cbdfd5f3a9c0d0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.068716 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9d4b82703a4c9a84cbdfd5f3a9c0d0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.076506 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9d4b82703a4c9a84cbdfd5f3a9c0d0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.088313 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9d4b82703a4c9a84cbdfd5f3a9c0d0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.089028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9d4b82703a4c9a84cbdfd5f3a9c0d0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.100866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1365/2724] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:34 2022] DELETE /identity/v3/users/1b9d4b82703a4c9a84cbdfd5f3a9c0d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:35.362739 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:35.364168 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:35.378213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0b90-6226-410d-8419-4db019a15b83 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:35.435257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:35.436120 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:35.436406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:35.436684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] PATH_INFO: `/v3/projects/403b5be169b44936951f7530348fc0a4` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:35.437896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=403b5be169b44936951f7530348fc0a4)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:35.439803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:35.485259 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403b5be169b44936951f7530348fc0a4', 'request_id': 'req-7bfdba78-668f-438d-994c-b5670c8fa20b'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.491390 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403b5be169b44936951f7530348fc0a4', 'request_id': 'req-7bfdba78-668f-438d-994c-b5670c8fa20b'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.498500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403b5be169b44936951f7530348fc0a4', 'request_id': 'req-7bfdba78-668f-438d-994c-b5670c8fa20b'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.508756 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] The token cache is being invalidate because project 403b5be169b44936951f7530348fc0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:35.509040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.509695 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.511219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1360/2725] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:35 2022] DELETE /identity/v3/projects/403b5be169b44936951f7530348fc0a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:35.515395 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:35.516769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:35.529163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918bc13-37fd-4e0a-b76a-8642731dfc7b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:35.568078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:35.584844 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:35.585853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:35.586133 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:35.586403 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] PATH_INFO: `/v3/users/5a6dac9c0f1f4de589396190f1a9dac4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:35.587573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6dac9c0f1f4de589396190f1a9dac4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:35.589539 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:35.633259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6dac9c0f1f4de589396190f1a9dac4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.633928 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6dac9c0f1f4de589396190f1a9dac4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.640686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6dac9c0f1f4de589396190f1a9dac4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.652350 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6dac9c0f1f4de589396190f1a9dac4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.652975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-214815b2-ddfa-41b9-976b-0f8898f4eb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6dac9c0f1f4de589396190f1a9dac4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:35.665012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1366/2726] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:35 2022] DELETE /identity/v3/users/5a6dac9c0f1f4de589396190f1a9dac4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:35.936472 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:35.937919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:35.950743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdba78-668f-438d-994c-b5670c8fa20b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:35.959775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:36.009971 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.010753 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.011052 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.011330 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] PATH_INFO: `/v3/projects/aa83b0618dc94bf48106854ba8864a8f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.012484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa83b0618dc94bf48106854ba8864a8f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.014422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.059487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa83b0618dc94bf48106854ba8864a8f', 'request_id': 'req-6bb2659d-1538-4cba-ab68-749d68eb591b'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:36.065448 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa83b0618dc94bf48106854ba8864a8f', 'request_id': 'req-6bb2659d-1538-4cba-ab68-749d68eb591b'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:36.072925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa83b0618dc94bf48106854ba8864a8f', 'request_id': 'req-6bb2659d-1538-4cba-ab68-749d68eb591b'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:36.083077 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] The token cache is being invalidate because project aa83b0618dc94bf48106854ba8864a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:36.083366 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:36.084019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-6bb2659d-1538-4cba-ab68-749d68eb591b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:36.085558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1361/2727] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:35 2022] DELETE /identity/v3/projects/aa83b0618dc94bf48106854ba8864a8f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:36.091901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4eb4c-e2ef-4c1a-a991-756cc3d4536f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.092193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4eb4c-e2ef-4c1a-a991-756cc3d4536f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.092475 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4eb4c-e2ef-4c1a-a991-756cc3d4536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.110138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b0a4eb4c-e2ef-4c1a-a991-756cc3d4536f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:36.111341 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b0a4eb4c-e2ef-4c1a-a991-756cc3d4536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:36.169108 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1367/2728] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:36.177309 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ea19-f31b-4f93-b8b0-f7e4cd9aae32 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.177635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ea19-f31b-4f93-b8b0-f7e4cd9aae32 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.177914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ea19-f31b-4f93-b8b0-f7e4cd9aae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.195824 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4cc6ea19-f31b-4f93-b8b0-f7e4cd9aae32 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:36.197019 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4cc6ea19-f31b-4f93-b8b0-f7e4cd9aae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:36.205294 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1362/2729] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:36.209339 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4eb4c-e2ef-4c1a-a991-756cc3d4536f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:36.219540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4eb4c-e2ef-4c1a-a991-756cc3d4536f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:36.224270 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.224917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.225223 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.225533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.226259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:44:36.226567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.228170 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.239435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1368/2730] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:44:36.243614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ea19-f31b-4f93-b8b0-f7e4cd9aae32 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:36.252898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ea19-f31b-4f93-b8b0-f7e4cd9aae32 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:36.257535 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.258174 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.258463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.258765 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.259459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.261945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.286590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1363/2731] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:36 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:36.291209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:36.301607 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efb8f-9309-4747-b387-b477b94bde0c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:36.345725 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:36.359800 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.360473 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.360757 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.361035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.361753 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.363656 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.383431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1369/2732] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:36 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:44:36.388395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:36.398559 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18a33-abe5-4c68-9a44-3dd9596e198e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:36.404033 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.404685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.404972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.405248 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.405996 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.407576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.417987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1364/2733] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:36.422082 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:36.432000 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8f34-b7b1-4c83-93a4-210b593fec89 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:36.436546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a833b4-a90b-4eba-a568-7e0e2635bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.437197 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a833b4-a90b-4eba-a568-7e0e2635bda6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.437510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a833b4-a90b-4eba-a568-7e0e2635bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.437796 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a833b4-a90b-4eba-a568-7e0e2635bda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.438520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a833b4-a90b-4eba-a568-7e0e2635bda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.440097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a833b4-a90b-4eba-a568-7e0e2635bda6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.450504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1370/2734] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:36.454310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:36.464130 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286fd52-020a-4913-a404-13e1d4b5c9a1 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:36.469250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.470158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.470441 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.470717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] PATH_INFO: `/v3/projects/e57f7efcd0244738a9bdf347f20e8982/users/045611ecec274b1ebadc2c9b4ba918a0/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.484854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57f7efcd0244738a9bdf347f20e8982, user_id=045611ecec274b1ebadc2c9b4ba918a0, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.487498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.500338 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1365/2735] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:36 2022] PUT /identity/v3/projects/e57f7efcd0244738a9bdf347f20e8982/users/045611ecec274b1ebadc2c9b4ba918a0/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:36.511693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8e3c7-25a6-46b2-bf3c-10df6e8dccfc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.512035 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8e3c7-25a6-46b2-bf3c-10df6e8dccfc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.512401 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8e3c7-25a6-46b2-bf3c-10df6e8dccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.538775 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9ba8e3c7-25a6-46b2-bf3c-10df6e8dccfc None None] MFA Rules not processed for user `045611ecec274b1ebadc2c9b4ba918a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:36.539957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ba8e3c7-25a6-46b2-bf3c-10df6e8dccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:36.602721 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1371/2736] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:36.613701 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:36.615400 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:36.656951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:36.673736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb88b07-ef1b-4629-ae79-2c4b6396413c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:36.677386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f9d6-84e0-4f13-8301-a41a6016d536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:36.678069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f9d6-84e0-4f13-8301-a41a6016d536 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:36.678355 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f9d6-84e0-4f13-8301-a41a6016d536 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:36.678634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f9d6-84e0-4f13-8301-a41a6016d536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:36.687566 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f9d6-84e0-4f13-8301-a41a6016d536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:36.689001 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f9d6-84e0-4f13-8301-a41a6016d536 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:36.698443 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1366/2737] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:39.642187 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8e3c7-25a6-46b2-bf3c-10df6e8dccfc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:39.703613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8e3c7-25a6-46b2-bf3c-10df6e8dccfc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:39.708031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:39.708885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:39.709166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:39.709438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] PATH_INFO: `/v3/users/045611ecec274b1ebadc2c9b4ba918a0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:39.710622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] RBAC: Authorizing `identity:delete_user(user_id=045611ecec274b1ebadc2c9b4ba918a0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:39.712507 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:39.757895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045611ecec274b1ebadc2c9b4ba918a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:39.758530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045611ecec274b1ebadc2c9b4ba918a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:39.765256 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045611ecec274b1ebadc2c9b4ba918a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:39.769729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:39.779838 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045611ecec274b1ebadc2c9b4ba918a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:39.780480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045611ecec274b1ebadc2c9b4ba918a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:39.793074 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1372/2738] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:39 2022] DELETE /identity/v3/users/045611ecec274b1ebadc2c9b4ba918a0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:39.797311 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:39.797803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:39.797924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:39.814714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:39.815896 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:39.872856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1367/2739] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:44:39.882241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:39.883686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:39.940711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cfafc-44ce-416c-b8ad-15479305872d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:39.944542 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb863985-013a-41aa-be16-e28cdff47b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:39.945210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863985-013a-41aa-be16-e28cdff47b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:39.945504 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863985-013a-41aa-be16-e28cdff47b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:39.945776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863985-013a-41aa-be16-e28cdff47b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:39.955219 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb863985-013a-41aa-be16-e28cdff47b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:39.956625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb863985-013a-41aa-be16-e28cdff47b21 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:39.966465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1373/2740] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:40.228754 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.231002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:40.244544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bebf96-8cb4-4ffa-b300-4432ffd330b4 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.249740 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.251272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.251571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.251847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] PATH_INFO: `/v3/projects/e57f7efcd0244738a9bdf347f20e8982` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.253059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57f7efcd0244738a9bdf347f20e8982)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.255383 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.301821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57f7efcd0244738a9bdf347f20e8982', 'request_id': 'req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:40.307809 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57f7efcd0244738a9bdf347f20e8982', 'request_id': 'req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:40.315115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57f7efcd0244738a9bdf347f20e8982', 'request_id': 'req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:40.327531 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] The token cache is being invalidate because project e57f7efcd0244738a9bdf347f20e8982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:40.327953 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:40.328601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-1bca5ffd-c3b1-411e-8922-6a7f6442d7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:40.330163 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1368/2741] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:40 2022] DELETE /identity/v3/projects/e57f7efcd0244738a9bdf347f20e8982 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:40.335150 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f516cbc-2d80-4774-aab2-c94c70b9cd5e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.335472 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f516cbc-2d80-4774-aab2-c94c70b9cd5e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.335755 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f516cbc-2d80-4774-aab2-c94c70b9cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.353802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7f516cbc-2d80-4774-aab2-c94c70b9cd5e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:40.355620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7f516cbc-2d80-4774-aab2-c94c70b9cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:40.412524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1374/2742] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:40.420843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636f35-37c0-4a52-a67e-56ce8ad0f96f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.421136 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636f35-37c0-4a52-a67e-56ce8ad0f96f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.421416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636f35-37c0-4a52-a67e-56ce8ad0f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.439187 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-30636f35-37c0-4a52-a67e-56ce8ad0f96f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:40.440378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-30636f35-37c0-4a52-a67e-56ce8ad0f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:40.448526 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1369/2743] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:40.452435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f516cbc-2d80-4774-aab2-c94c70b9cd5e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.462095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f516cbc-2d80-4774-aab2-c94c70b9cd5e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.467619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.468264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.468548 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.468824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.469575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:44:40.469885 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.471468 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.483559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1375/2744] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:44:40.487269 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636f35-37c0-4a52-a67e-56ce8ad0f96f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.496418 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636f35-37c0-4a52-a67e-56ce8ad0f96f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.501007 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.501673 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.501959 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.502236 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.502931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.504821 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.531234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1370/2745] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:40 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:44:40.534612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.545018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76c872-1d6b-439b-b0d5-c654e9b1ce35 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.599182 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.599836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.600118 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.600676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.601367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.603278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.613081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:40.627670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1376/2746] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:40 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:40.628804 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.639501 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438a3a-a782-4478-a2f3-f3755747a3ae admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.644053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.644700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.644979 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.645249 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.646007 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.647579 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.659337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1371/2747] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:44:40.663157 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.672871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17528b-adb0-43ad-8a26-efcee9078e4e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.677385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88c7a-dd92-41ef-ba01-e9029a724d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.678066 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88c7a-dd92-41ef-ba01-e9029a724d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.678347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88c7a-dd92-41ef-ba01-e9029a724d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.678622 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88c7a-dd92-41ef-ba01-e9029a724d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.679333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88c7a-dd92-41ef-ba01-e9029a724d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.680901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88c7a-dd92-41ef-ba01-e9029a724d8e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.690568 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1377/2748] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:40.694652 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.704846 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c33ce0-378b-4fdd-a358-ccd2d0eaa86d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.709590 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.710452 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.710737 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.711008 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] PATH_INFO: `/v3/projects/84891c8223d9430cb4b48c9a2e0451b7/users/977d4148f6fe4cfabf636de6eeda69d3/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.725851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84891c8223d9430cb4b48c9a2e0451b7, user_id=977d4148f6fe4cfabf636de6eeda69d3, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.728463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.737343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:40.742808 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1372/2749] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:40 2022] PUT /identity/v3/projects/84891c8223d9430cb4b48c9a2e0451b7/users/977d4148f6fe4cfabf636de6eeda69d3/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:40.752665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75216b4-1785-4999-b9bd-e52fa1a017e7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.752949 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75216b4-1785-4999-b9bd-e52fa1a017e7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.753272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75216b4-1785-4999-b9bd-e52fa1a017e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.779801 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f75216b4-1785-4999-b9bd-e52fa1a017e7 None None] MFA Rules not processed for user `977d4148f6fe4cfabf636de6eeda69d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:40.780986 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f75216b4-1785-4999-b9bd-e52fa1a017e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:40.843974 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1378/2750] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:40.848357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.909726 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46d1f-acc2-4e8f-bedf-3ee6c4976aa2 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:40.914371 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:40.914968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:40.915253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:40.915528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:40.916208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:40.918612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:40.943540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1373/2751] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:40 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:40.947710 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75216b4-1785-4999-b9bd-e52fa1a017e7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:40.958285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75216b4-1785-4999-b9bd-e52fa1a017e7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.013554 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.014218 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.014505 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.014781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.015467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.017438 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.037159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1379/2752] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:40 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:41.041110 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.051420 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee802-f560-4b58-a7b7-56e91a873277 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.056079 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.056742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.057030 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.057308 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.058599 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.060186 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.071061 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1374/2753] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:41.075298 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.085143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3f18-701f-492c-b204-6434e6fb8ab2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.089732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fb4e6-b8fa-4e76-a78d-81b14e5c90f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.090381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb4e6-b8fa-4e76-a78d-81b14e5c90f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.090669 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb4e6-b8fa-4e76-a78d-81b14e5c90f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.090947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb4e6-b8fa-4e76-a78d-81b14e5c90f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.091670 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fb4e6-b8fa-4e76-a78d-81b14e5c90f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.093369 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fb4e6-b8fa-4e76-a78d-81b14e5c90f2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.103331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1380/2754] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:41.107298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.117152 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aee1c-4058-41e2-88cb-db04847cc10c admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.122295 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.123230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.123516 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.123801 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] PATH_INFO: `/v3/projects/49304c76d21b483a90fded61958e061a/users/736c931fbdfb4b1fbbbbf66dc34c4e93/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.138528 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49304c76d21b483a90fded61958e061a, user_id=736c931fbdfb4b1fbbbbf66dc34c4e93, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.141146 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.158329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1375/2755] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:41 2022] PUT /identity/v3/projects/49304c76d21b483a90fded61958e061a/users/736c931fbdfb4b1fbbbbf66dc34c4e93/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:44:41.169230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf44a8-ce6f-4aae-96ec-be47f99411bd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.169530 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf44a8-ce6f-4aae-96ec-be47f99411bd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.169816 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf44a8-ce6f-4aae-96ec-be47f99411bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.195895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-15cf44a8-ce6f-4aae-96ec-be47f99411bd None None] MFA Rules not processed for user `736c931fbdfb4b1fbbbbf66dc34c4e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:41.197083 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-15cf44a8-ce6f-4aae-96ec-be47f99411bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:41.236824 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:41.259479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1381/2756] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:41.264416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.325017 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5c939-535b-4693-805b-528acbef1a9e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.329628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.330272 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.330554 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.330828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.331507 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.333379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.361036 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1376/2757] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:41 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:41.364848 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf44a8-ce6f-4aae-96ec-be47f99411bd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.375566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf44a8-ce6f-4aae-96ec-be47f99411bd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.430963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.431653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.431966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.432236 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.432923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.434862 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.454665 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1382/2758] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:41 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:41.458545 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.469284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c296fc-d9f6-4e3f-b7f7-8042a4ea132e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.473997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.474649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.474934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.475213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.475937 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.477543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.488118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1377/2759] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:41.491941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.501653 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e704f8b-41e2-49f4-a5f1-64a32d212af6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.506131 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.506992 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.507275 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.507547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] PATH_INFO: `/v3/projects/403361d22f7e45be8ae1ea052779d163/users/1506d0fb2b3c4073aece70b79be6e310/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.522321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=403361d22f7e45be8ae1ea052779d163, user_id=1506d0fb2b3c4073aece70b79be6e310, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.524916 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.538975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1383/2760] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:41 2022] PUT /identity/v3/projects/403361d22f7e45be8ae1ea052779d163/users/1506d0fb2b3c4073aece70b79be6e310/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:41.542929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.552691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a224-fdf3-4fe9-9940-510be13f34ff admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.572606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:41.610006 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7482100-8302-456d-9f16-d2023fd0fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.610709 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7482100-8302-456d-9f16-d2023fd0fb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.610994 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7482100-8302-456d-9f16-d2023fd0fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.611268 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7482100-8302-456d-9f16-d2023fd0fb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.611981 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7482100-8302-456d-9f16-d2023fd0fb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.613634 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7482100-8302-456d-9f16-d2023fd0fb44 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.623426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1378/2761] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:41.627498 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.638342 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cad57-d381-4823-aa13-5c7bdefaca9c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.642917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.643789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.644069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.644345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] PATH_INFO: `/v3/projects/403361d22f7e45be8ae1ea052779d163/users/1506d0fb2b3c4073aece70b79be6e310/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.646372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=403361d22f7e45be8ae1ea052779d163, user_id=1506d0fb2b3c4073aece70b79be6e310, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.648981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.659547 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1384/2762] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:41 2022] PUT /identity/v3/projects/403361d22f7e45be8ae1ea052779d163/users/1506d0fb2b3c4073aece70b79be6e310/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:41.669127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.669515 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.669799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.695555 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] MFA Rules not processed for user `1506d0fb2b3c4073aece70b79be6e310`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:41.696678 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:41.765048 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1379/2763] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:41.776267 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:41.778002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:41.834760 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61aeb-7e89-4b79-acca-8f833dd1a08e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:41.838347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:41.838978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:41.839259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:41.839536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:41.884722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:41.895480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:41.896901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:41.905713 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1385/2764] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:44:43.364496 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:43.365940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:43.378286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe7157-175f-4f25-ac55-c192d020f6bd None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:43.381794 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:43.382427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:43.382711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:43.382988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:43.438411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:43.439761 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:43.448780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1380/2765] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:43.947045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:43.955709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69716a06-c7b7-48f2-9ecf-73f875fa907e service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:43.959383 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96b8e1-ff13-4c2c-a89c-6473d3df2a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:43.960012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96b8e1-ff13-4c2c-a89c-6473d3df2a7a service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:43.960297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96b8e1-ff13-4c2c-a89c-6473d3df2a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:43.960586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96b8e1-ff13-4c2c-a89c-6473d3df2a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:43.969431 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96b8e1-ff13-4c2c-a89c-6473d3df2a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:43.970808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96b8e1-ff13-4c2c-a89c-6473d3df2a7a service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:43.980002 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1386/2766] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:47.792879 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:47.838540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=100 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:47.855463 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bea82-a34f-4d7c-b977-27bf15d9ae34 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:47.860054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:47.860917 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:47.861203 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:47.861506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] PATH_INFO: `/v3/users/977d4148f6fe4cfabf636de6eeda69d3` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:47.862704 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977d4148f6fe4cfabf636de6eeda69d3)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:47.864624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:47.911786 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977d4148f6fe4cfabf636de6eeda69d3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:47.912434 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977d4148f6fe4cfabf636de6eeda69d3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:47.924613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977d4148f6fe4cfabf636de6eeda69d3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:47.925246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977d4148f6fe4cfabf636de6eeda69d3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:47.932164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977d4148f6fe4cfabf636de6eeda69d3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:47.944624 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1381/2767] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:47 2022] DELETE /identity/v3/users/977d4148f6fe4cfabf636de6eeda69d3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:47.949049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:47.949558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:47.949682 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:47.966869 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:47.968070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:48.025591 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1387/2768] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:48.035497 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:48.036876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:48.094436 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8ca6-4d09-4dae-8bbc-932ae30c6d90 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:48.098083 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:48.098723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:48.099005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:48.099280 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:48.108779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:48.110231 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:48.119585 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1382/2769] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:44:48.385717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:48.387161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:48.399600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778d26-8d9e-4686-a804-584290ea337d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:48.405312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:48.406210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:48.406480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:48.406756 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] PATH_INFO: `/v3/projects/84891c8223d9430cb4b48c9a2e0451b7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:48.408111 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84891c8223d9430cb4b48c9a2e0451b7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:48.411279 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:48.460871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84891c8223d9430cb4b48c9a2e0451b7', 'request_id': 'req-bfba6ad5-05eb-49de-be0d-21d21398b6d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.468099 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84891c8223d9430cb4b48c9a2e0451b7', 'request_id': 'req-bfba6ad5-05eb-49de-be0d-21d21398b6d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.474233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84891c8223d9430cb4b48c9a2e0451b7', 'request_id': 'req-bfba6ad5-05eb-49de-be0d-21d21398b6d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.484767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] The token cache is being invalidate because project 84891c8223d9430cb4b48c9a2e0451b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:48.485055 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.485944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.487456 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1388/2770] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:48 2022] DELETE /identity/v3/projects/84891c8223d9430cb4b48c9a2e0451b7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:48.491413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:48.501751 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fa28d-3427-4e6d-95f2-335ad156594d service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:48.557702 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:48.558495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:48.558795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:48.559059 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] PATH_INFO: `/v3/users/736c931fbdfb4b1fbbbbf66dc34c4e93` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:48.560252 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736c931fbdfb4b1fbbbbf66dc34c4e93)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:48.562211 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:48.567426 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:48.608708 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736c931fbdfb4b1fbbbbf66dc34c4e93'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.609364 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736c931fbdfb4b1fbbbbf66dc34c4e93'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.621876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736c931fbdfb4b1fbbbbf66dc34c4e93'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.622509 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736c931fbdfb4b1fbbbbf66dc34c4e93'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.629618 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736c931fbdfb4b1fbbbbf66dc34c4e93'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:48.641960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1383/2771] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:48 2022] DELETE /identity/v3/users/736c931fbdfb4b1fbbbbf66dc34c4e93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:48.909045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:48.910480 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:48.924371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6ad5-05eb-49de-be0d-21d21398b6d6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:48.987787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:48.988643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:48.988921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:48.989193 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] PATH_INFO: `/v3/projects/49304c76d21b483a90fded61958e061a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:48.990380 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49304c76d21b483a90fded61958e061a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:48.992307 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:48.993771 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:49.040261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49304c76d21b483a90fded61958e061a', 'request_id': 'req-853cc101-45ad-4558-b38e-9b74b0428516'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.046910 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49304c76d21b483a90fded61958e061a', 'request_id': 'req-853cc101-45ad-4558-b38e-9b74b0428516'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.053408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49304c76d21b483a90fded61958e061a', 'request_id': 'req-853cc101-45ad-4558-b38e-9b74b0428516'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.063762 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] The token cache is being invalidate because project 49304c76d21b483a90fded61958e061a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:49.064049 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.064709 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.066271 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1389/2772] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:48 2022] DELETE /identity/v3/projects/49304c76d21b483a90fded61958e061a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:49.070518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:49.071967 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:49.085133 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75285-88d9-4073-a854-19e5507b77b7 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:49.140368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:49.141255 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.141570 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.141849 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] PATH_INFO: `/v3/users/1506d0fb2b3c4073aece70b79be6e310` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.143025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1506d0fb2b3c4073aece70b79be6e310)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:49.144936 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:49.196058 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1506d0fb2b3c4073aece70b79be6e310'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.196714 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1506d0fb2b3c4073aece70b79be6e310'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.208856 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1506d0fb2b3c4073aece70b79be6e310'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.209513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1506d0fb2b3c4073aece70b79be6e310'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.217182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c8a936d3-25d2-4be2-a363-4639400df6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1506d0fb2b3c4073aece70b79be6e310'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.229658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1384/2773] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:44:49 2022] DELETE /identity/v3/users/1506d0fb2b3c4073aece70b79be6e310 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:44:49.495372 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:49.497430 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:49.516722 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc101-45ad-4558-b38e-9b74b0428516 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:49.572701 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:49.573594 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.573873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.574147 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] PATH_INFO: `/v3/projects/403361d22f7e45be8ae1ea052779d163` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.575857 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403361d22f7e45be8ae1ea052779d163)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:49.577802 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:49.622592 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403361d22f7e45be8ae1ea052779d163', 'request_id': 'req-22159fc8-d766-4092-8ef3-86a350f85ea3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.631564 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403361d22f7e45be8ae1ea052779d163', 'request_id': 'req-22159fc8-d766-4092-8ef3-86a350f85ea3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.638674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403361d22f7e45be8ae1ea052779d163', 'request_id': 'req-22159fc8-d766-4092-8ef3-86a350f85ea3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.648804 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] The token cache is being invalidate because project 403361d22f7e45be8ae1ea052779d163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:44:49.649089 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.649745 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22159fc8-d766-4092-8ef3-86a350f85ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:44:49.651281 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1390/2774] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:44:49 2022] DELETE /identity/v3/projects/403361d22f7e45be8ae1ea052779d163 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:44:49.656387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b460-e79c-4def-8620-0f0733a2760e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.656680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b460-e79c-4def-8620-0f0733a2760e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.656963 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b460-e79c-4def-8620-0f0733a2760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.664114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:49.677123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-4fb2b460-e79c-4def-8620-0f0733a2760e None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:49.679025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-4fb2b460-e79c-4def-8620-0f0733a2760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:49.737342 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1385/2775] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:49.745331 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2da97-c6a4-4cfa-a131-baae88d37e86 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.745652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2da97-c6a4-4cfa-a131-baae88d37e86 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.745929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2da97-c6a4-4cfa-a131-baae88d37e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.764707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-37b2da97-c6a4-4cfa-a131-baae88d37e86 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:49.765931 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-37b2da97-c6a4-4cfa-a131-baae88d37e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:49.773692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1391/2776] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:49.777857 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b460-e79c-4def-8620-0f0733a2760e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:49.788173 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b460-e79c-4def-8620-0f0733a2760e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:49.792674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:49.793343 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.793721 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.793998 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.794722 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:44:49.795031 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:49.796611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:49.808209 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1386/2777] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:44:49.812242 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2da97-c6a4-4cfa-a131-baae88d37e86 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:49.822016 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2da97-c6a4-4cfa-a131-baae88d37e86 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:49.827144 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:49.827782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.828065 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.828338 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.829019 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:49.830921 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:49.840479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:49.856641 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1392/2778] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:44:49 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:44:49.860637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:49.870606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75857d9d-66b7-4ae1-9482-7b8bfe72b9ee admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:49.926270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:49.926961 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.927276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.927558 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] PATH_INFO: `/v3/users` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.928262 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:49.930199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:49.950962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1387/2779] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:44:49 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:44:49.955022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:49.965364 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ac687-f9ef-40af-b4d0-2b798f0a58df admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:49.970534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:49.971188 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:49.971469 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:49.971747 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:49.972465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:49.974071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:49.984826 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1393/2780] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:49.988458 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:49.998972 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0280-d451-47a0-abcb-a0a8a10bec82 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:50.003609 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a5a4e-d37f-461b-8b76-e505a6e1d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:50.004254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a5a4e-d37f-461b-8b76-e505a6e1d877 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:50.004540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a5a4e-d37f-461b-8b76-e505a6e1d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:50.004818 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a5a4e-d37f-461b-8b76-e505a6e1d877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:50.005603 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a5a4e-d37f-461b-8b76-e505a6e1d877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:50.007176 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a5a4e-d37f-461b-8b76-e505a6e1d877 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:50.017095 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1388/2781] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:44:50.020873 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:50.031156 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29af7-8330-47f3-a2b4-5252ed0e0a68 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:50.035681 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:50.036650 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:50.036947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:50.037221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] PATH_INFO: `/v3/projects/f2fee1342c7a47afb37d888abbbb1914/users/185ac2b4dfed4c7b9b9b78fa2ab0d418/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:50.051883 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2fee1342c7a47afb37d888abbbb1914, user_id=185ac2b4dfed4c7b9b9b78fa2ab0d418, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:50.054517 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:50.067450 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1394/2782] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:44:50 2022] PUT /identity/v3/projects/f2fee1342c7a47afb37d888abbbb1914/users/185ac2b4dfed4c7b9b9b78fa2ab0d418/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:44:50.079286 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232379-d1f9-44c3-8ed4-4de8abe20c13 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:50.079789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232379-d1f9-44c3-8ed4-4de8abe20c13 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:50.079903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232379-d1f9-44c3-8ed4-4de8abe20c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:50.105421 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0e232379-d1f9-44c3-8ed4-4de8abe20c13 None None] MFA Rules not processed for user `185ac2b4dfed4c7b9b9b78fa2ab0d418`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:44:50.106672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0e232379-d1f9-44c3-8ed4-4de8abe20c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:50.166629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:44:50.173729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1389/2783] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:44:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:44:50.181075 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:44:50.182782 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:44:50.238488 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bab3e-a5eb-4744-8fd6-24d80bab6b52 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:44:50.242132 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7370-c635-431d-886f-b70f5078971b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:44:50.242773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7370-c635-431d-886f-b70f5078971b service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:44:50.243061 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7370-c635-431d-886f-b70f5078971b service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:44:50.243340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7370-c635-431d-886f-b70f5078971b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:44:50.252263 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7370-c635-431d-886f-b70f5078971b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:44:50.253712 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7370-c635-431d-886f-b70f5078971b service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:44:50.263038 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1395/2784] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:44:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:45:00.258435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:45:11.471384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e232379-d1f9-44c3-8ed4-4de8abe20c13 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:45:11.532522 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e232379-d1f9-44c3-8ed4-4de8abe20c13 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:45:11.537018 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:45:11.537914 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:45:11.538204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:45:11.538481 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] PATH_INFO: `/v3/users/185ac2b4dfed4c7b9b9b78fa2ab0d418` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:45:11.539667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=185ac2b4dfed4c7b9b9b78fa2ab0d418)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:45:11.541611 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:45:11.588527 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185ac2b4dfed4c7b9b9b78fa2ab0d418'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:11.589179 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185ac2b4dfed4c7b9b9b78fa2ab0d418'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:11.601149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185ac2b4dfed4c7b9b9b78fa2ab0d418'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:11.601819 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185ac2b4dfed4c7b9b9b78fa2ab0d418'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:11.609670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185ac2b4dfed4c7b9b9b78fa2ab0d418'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:11.622556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1390/2785] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:45:11 2022] DELETE /identity/v3/users/185ac2b4dfed4c7b9b9b78fa2ab0d418 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:45:11.627105 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:45:11.627585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:45:11.627688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:45:11.644062 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:45:11.645260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:45:11.702780 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1396/2786] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:45:11.712406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:45:11.713860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:45:11.770103 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f42c6-4e44-4194-81e9-323be6481d14 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:45:11.773716 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51cf3b-7a61-4662-9288-8cd42f90fa04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:45:11.774348 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cf3b-7a61-4662-9288-8cd42f90fa04 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:45:11.774629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cf3b-7a61-4662-9288-8cd42f90fa04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:45:11.774902 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cf3b-7a61-4662-9288-8cd42f90fa04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:45:11.784353 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51cf3b-7a61-4662-9288-8cd42f90fa04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:45:11.785812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51cf3b-7a61-4662-9288-8cd42f90fa04 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:45:11.795851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1391/2787] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:45:12.053417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:45:12.054969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:45:12.071477 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40317-1f2e-4a64-ba9b-224a6948c78f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:45:12.076361 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:45:12.077489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:45:12.077859 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:45:12.078315 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] PATH_INFO: `/v3/projects/f2fee1342c7a47afb37d888abbbb1914` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:45:12.079797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2fee1342c7a47afb37d888abbbb1914)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:45:12.082015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:45:12.127999 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2fee1342c7a47afb37d888abbbb1914', 'request_id': 'req-9c6b8341-59dc-485f-b21f-29c54732f949'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:12.135101 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2fee1342c7a47afb37d888abbbb1914', 'request_id': 'req-9c6b8341-59dc-485f-b21f-29c54732f949'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:12.141936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2fee1342c7a47afb37d888abbbb1914', 'request_id': 'req-9c6b8341-59dc-485f-b21f-29c54732f949'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:12.152126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] The token cache is being invalidate because project f2fee1342c7a47afb37d888abbbb1914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:45:12.152405 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:12.153643 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:45:12.155161 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1397/2788] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:45:12 2022] DELETE /identity/v3/projects/f2fee1342c7a47afb37d888abbbb1914 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:45:21.791014 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:45:22.149073 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:46:05.038648 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:46:05.039182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:46:05.039182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:46:05.055774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] MFA Rules not processed for user `3c45d1f824304bee88d8bd04a2d106e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:46:05.056962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:46:05.109729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1392/2789] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:46:15.103235 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=25 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:48:16.798697 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:48:16.800088 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:48:16.870311 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8341-59dc-485f-b21f-29c54732f949 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:48:16.875287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:48:16.875930 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:48:16.876215 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:48:16.876492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:48:16.878266 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:48:16.889496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:48:16.891070 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:48:16.901177 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1398/2790] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:48:26.896676 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=32 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:49:03.566193 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:49:03.567876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:49:03.623598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41e32-e402-494c-87ee-0985cede1445 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:49:03.627113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:49:03.628289 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:49:03.628578 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:49:03.628858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:49:03.630616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:49:03.641054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:49:03.642494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:49:03.651207 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1393/2791] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:49:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:49:13.647246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=26 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:53:22.826556 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:53:22.828599 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:53:22.878875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c4259-9bf0-496f-90e0-ff18f45d2cca service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:53:22.883832 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f40962-307e-4349-b437-ab707674de06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:53:22.884462 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f40962-307e-4349-b437-ab707674de06 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:53:22.884742 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f40962-307e-4349-b437-ab707674de06 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:53:22.885015 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f40962-307e-4349-b437-ab707674de06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:53:22.893976 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f40962-307e-4349-b437-ab707674de06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:53:22.895527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f40962-307e-4349-b437-ab707674de06 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:53:22.905171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1399/2792] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:53:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:53:32.900979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=23 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:54:04.343885 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:54:04.345312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:54:04.375427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3399-f1c7-4983-a62b-2bccfa8770c6 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:54:04.379661 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:54:04.380300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:54:04.380583 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:54:04.380858 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:54:04.389208 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:54:04.390658 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:54:04.416774 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1394/2793] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:54:14.414204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=22 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:58:27.835497 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f40962-307e-4349-b437-ab707674de06 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:58:27.839387 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-41f40962-307e-4349-b437-ab707674de06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:58:27.942603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f40962-307e-4349-b437-ab707674de06 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:58:27.948222 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965091-a724-4073-a498-adcab5aad420 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:58:27.948861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965091-a724-4073-a498-adcab5aad420 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:58:27.949153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965091-a724-4073-a498-adcab5aad420 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:58:27.949429 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965091-a724-4073-a498-adcab5aad420 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:58:27.951317 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-76965091-a724-4073-a498-adcab5aad420 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:58:27.962520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76965091-a724-4073-a498-adcab5aad420 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:58:27.964087 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76965091-a724-4073-a498-adcab5aad420 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:58:27.973906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1400/2794] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:58:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:58:37.969734 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=42 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:03.864781 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:03.927267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4f8d-cd3c-432e-a828-a945cef2621a service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:03.930904 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:03.931543 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:03.931829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:03.932110 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:03.934035 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:04.002242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:04.003667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:04.012635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1395/2795] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:14.008532 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=57 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:38.706956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965091-a724-4073-a498-adcab5aad420 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:38.708836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-76965091-a724-4073-a498-adcab5aad420 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:38.784018 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965091-a724-4073-a498-adcab5aad420 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:38.787545 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:38.788176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:38.788455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:38.788728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:38.790470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:38.870783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:38.872122 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:38.891503 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1401/2796] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:41.901594 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:41.913195 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a34ec-34d5-46a0-b0c3-1194445643b8 service cinder] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:41.918250 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:41.918997 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:41.919378 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:41.919748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:41.921668 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:41.934199 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:41.935780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:41.948386 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1396/2797] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:41.955674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:41.957100 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:41.970516 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaf36e-7d7a-412c-9552-fc30228a2c88 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:41.977479 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:41.978478 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:41.978821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:41.979159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] PATH_INFO: `/v3/users/3c45d1f824304bee88d8bd04a2d106e4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:41.980412 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c45d1f824304bee88d8bd04a2d106e4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:41.982420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.028490 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c45d1f824304bee88d8bd04a2d106e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.029069 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c45d1f824304bee88d8bd04a2d106e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.036136 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c45d1f824304bee88d8bd04a2d106e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.038146 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:42.049836 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c45d1f824304bee88d8bd04a2d106e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.050492 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5b84fd8-55f5-45a9-a967-e4e51f26855e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c45d1f824304bee88d8bd04a2d106e4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.063126 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1402/2798] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:59:41 2022] DELETE /identity/v3/users/3c45d1f824304bee88d8bd04a2d106e4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:42.229805 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.241164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f6d2-12fc-44c0-a11a-73f61a29b625 service placement] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:42.297326 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:42.298127 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.298411 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.298685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] PATH_INFO: `/v3/projects/cfa2a7973f13461cb930cc0cd8d3fc8a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.300142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa2a7973f13461cb930cc0cd8d3fc8a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:42.302137 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.347854 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa2a7973f13461cb930cc0cd8d3fc8a', 'request_id': 'req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.354181 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa2a7973f13461cb930cc0cd8d3fc8a', 'request_id': 'req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.362144 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa2a7973f13461cb930cc0cd8d3fc8a', 'request_id': 'req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.372931 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] The token cache is being invalidate because project cfa2a7973f13461cb930cc0cd8d3fc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:59:42.373244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.373901 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-851fd0cc-ad0b-4d25-8a94-3c29f77ccb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:42.376025 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1397/2799] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:59:42 2022] DELETE /identity/v3/projects/cfa2a7973f13461cb930cc0cd8d3fc8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:42.381889 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459ce11-7f05-4e79-815e-29c7b869cbfd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.382209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459ce11-7f05-4e79-815e-29c7b869cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.382494 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459ce11-7f05-4e79-815e-29c7b869cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.438022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8459ce11-7f05-4e79-815e-29c7b869cbfd None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:42.439466 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8459ce11-7f05-4e79-815e-29c7b869cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:42.495814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1403/2800] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:42.503905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163181e2-4c3f-4dbe-bb01-f961fb1c4527 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.504200 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163181e2-4c3f-4dbe-bb01-f961fb1c4527 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.504487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163181e2-4c3f-4dbe-bb01-f961fb1c4527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.523164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-163181e2-4c3f-4dbe-bb01-f961fb1c4527 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:42.524379 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-163181e2-4c3f-4dbe-bb01-f961fb1c4527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:42.532733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1398/2801] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:42.536871 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459ce11-7f05-4e79-815e-29c7b869cbfd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.547138 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459ce11-7f05-4e79-815e-29c7b869cbfd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:42.551705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:42.552291 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.552577 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.552852 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.553612 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:59:42.553941 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:42.555515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.567139 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1404/2802] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:59:42.571300 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163181e2-4c3f-4dbe-bb01-f961fb1c4527 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.580419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163181e2-4c3f-4dbe-bb01-f961fb1c4527 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:42.585024 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:42.585690 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.585978 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.586256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.586945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:42.588816 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.623327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1399/2803] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:59:42 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:42.627347 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.637232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0171966-93fb-47e8-9a29-ff203c3f37f3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:42.692322 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:42.692979 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.693264 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.693569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.694261 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:42.696162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.715029 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1405/2804] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:59:42 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:42.719503 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.729769 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e70c7e-6f0d-4c78-a698-2fd554940d59 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:42.734933 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:42.735581 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.735864 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.736140 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.736862 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:42.738495 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.748213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1400/2805] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:42.751894 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.761527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748eba5-a3c6-4bb2-a579-0f40bd742ecf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:42.766032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8780c-f61a-4f7d-bebd-4fd616702e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:42.766674 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8780c-f61a-4f7d-bebd-4fd616702e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.766956 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8780c-f61a-4f7d-bebd-4fd616702e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.767228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8780c-f61a-4f7d-bebd-4fd616702e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.767939 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8780c-f61a-4f7d-bebd-4fd616702e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:42.769559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8780c-f61a-4f7d-bebd-4fd616702e38 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.781384 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1406/2806] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:42.785220 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.795022 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dfcff-14e5-433a-9aa4-c45305e8d138 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:42.800245 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:42.801113 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.801396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.801758 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] PATH_INFO: `/v3/projects/a6db858fb38d40209a55dfdb79bd468f/users/27b679a80997418099870e840d73b370/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.817500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6db858fb38d40209a55dfdb79bd468f, user_id=27b679a80997418099870e840d73b370, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:42.820115 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:42.833257 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1401/2807] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:42 2022] PUT /identity/v3/projects/a6db858fb38d40209a55dfdb79bd468f/users/27b679a80997418099870e840d73b370/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:42.843861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:42.844148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:42.844423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:42.861969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:42.871570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] MFA Rules not processed for user `27b679a80997418099870e840d73b370`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:42.873408 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:42.935569 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1407/2808] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:42.946629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:42.948384 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:42.953562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:43.049803 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4f68d-bb65-446b-81c6-0827af361c6e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:43.055562 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe6b95088494836b8598ea8f33d5167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:43.056159 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:43.056435 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:43.056711 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:43.064748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:43.066337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:43.075038 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1402/2809] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:43.095045 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:43.096417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:43.162171 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce6108-e280-47ae-95b2-e2bc292006c3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:43.165708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:43.166344 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:43.166627 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:43.166902 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:43.168662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:43.181735 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:43.183149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:43.194813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1408/2810] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:43.500684 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:43.512325 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b9897-c92a-44a4-9e94-1738579364b2 service nova] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:43.516775 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b272-1324-46ea-823c-cde74bfb5347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:43.517422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b272-1324-46ea-823c-cde74bfb5347 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:43.517736 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b272-1324-46ea-823c-cde74bfb5347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:43.518016 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b272-1324-46ea-823c-cde74bfb5347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:43.520563 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a8a1b272-1324-46ea-823c-cde74bfb5347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:43.535375 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1b272-1324-46ea-823c-cde74bfb5347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:43.536843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1b272-1324-46ea-823c-cde74bfb5347 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:43.548128 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1403/2811] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:45.886533 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:45.944603 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddadbaf-adb3-4ce4-9213-d1d97a3a25a8 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:45.949159 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:45.950048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:45.950333 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:45.950613 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] PATH_INFO: `/v3/users/27b679a80997418099870e840d73b370` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:45.951792 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b679a80997418099870e840d73b370)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:45.954230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:45.986693 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:46.002875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b679a80997418099870e840d73b370'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.002875 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b679a80997418099870e840d73b370'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.008982 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b679a80997418099870e840d73b370'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.024121 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b679a80997418099870e840d73b370'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.024783 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b679a80997418099870e840d73b370'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.038831 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1409/2812] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:59:45 2022] DELETE /identity/v3/users/27b679a80997418099870e840d73b370 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:46.043377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.043869 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.044070 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.061632 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:46.062900 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:46.121284 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1404/2813] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:46.130917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.132340 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:46.190036 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0027b41-8eaf-4641-8ee9-158f79ec7dcd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.193717 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374baf9-c123-45d2-9664-9c838487c1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.194354 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374baf9-c123-45d2-9664-9c838487c1cb service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.194640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374baf9-c123-45d2-9664-9c838487c1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.194917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374baf9-c123-45d2-9664-9c838487c1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.204382 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374baf9-c123-45d2-9664-9c838487c1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.205832 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374baf9-c123-45d2-9664-9c838487c1cb service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.215293 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1410/2814] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:46.481876 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.483298 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:46.495172 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5a9e-27d5-4648-89d6-3fa38991dfc9 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.500276 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.501129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.501407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.502912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] PATH_INFO: `/v3/projects/a6db858fb38d40209a55dfdb79bd468f` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.504604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6db858fb38d40209a55dfdb79bd468f)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.506556 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.556498 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:46.560102 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6db858fb38d40209a55dfdb79bd468f', 'request_id': 'req-bc03747b-fe96-44eb-814d-fa360903747f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.567582 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6db858fb38d40209a55dfdb79bd468f', 'request_id': 'req-bc03747b-fe96-44eb-814d-fa360903747f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.574692 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6db858fb38d40209a55dfdb79bd468f', 'request_id': 'req-bc03747b-fe96-44eb-814d-fa360903747f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.585393 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] The token cache is being invalidate because project a6db858fb38d40209a55dfdb79bd468f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:59:46.585713 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.586329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-bc03747b-fe96-44eb-814d-fa360903747f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:46.587855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1405/2815] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:59:46 2022] DELETE /identity/v3/projects/a6db858fb38d40209a55dfdb79bd468f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:46.592686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ec692-3c6c-4495-881d-f1ce8e85c25f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.592977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ec692-3c6c-4495-881d-f1ce8e85c25f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.593258 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ec692-3c6c-4495-881d-f1ce8e85c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.611241 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c74ec692-3c6c-4495-881d-f1ce8e85c25f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:46.612437 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c74ec692-3c6c-4495-881d-f1ce8e85c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:46.669072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1411/2816] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:46.677315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae570-127a-444c-9515-e14a6dfb0371 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.677637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae570-127a-444c-9515-e14a6dfb0371 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.677920 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae570-127a-444c-9515-e14a6dfb0371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.696456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b87ae570-127a-444c-9515-e14a6dfb0371 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:46.697667 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b87ae570-127a-444c-9515-e14a6dfb0371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:46.705401 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1406/2817] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:46.709420 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ec692-3c6c-4495-881d-f1ce8e85c25f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.718912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ec692-3c6c-4495-881d-f1ce8e85c25f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.723378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.724013 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.724294 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.724566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.725282 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:59:46.725611 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.727186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.738973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1412/2818] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:59:46.742886 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae570-127a-444c-9515-e14a6dfb0371 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.752486 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae570-127a-444c-9515-e14a6dfb0371 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.757302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.758046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.758339 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.758621 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.759310 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.761246 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.785843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1407/2819] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:59:46 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:46.789926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.800226 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402beb1-b2e5-45f9-a27b-c448e3fd4164 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.837767 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:46.857210 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.857901 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.858180 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.858453 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.859637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.861549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.881467 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1413/2820] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:59:46 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:46.885669 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.895743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1047870-6268-4c20-884a-0b620c3d1cea admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.900312 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.900962 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.901247 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.901555 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.902302 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.903881 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.915698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1408/2821] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:46.918409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.928763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d826d-0244-4186-8c14-ebc277657d77 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.933228 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9930-b1e5-4d34-9d89-22127d7cb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.933917 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9930-b1e5-4d34-9d89-22127d7cb3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.934199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9930-b1e5-4d34-9d89-22127d7cb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.934476 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9930-b1e5-4d34-9d89-22127d7cb3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.935194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9930-b1e5-4d34-9d89-22127d7cb3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.936776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9930-b1e5-4d34-9d89-22127d7cb3ab admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.948053 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1414/2822] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:46.951797 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:46.961688 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf133471-08cc-45dd-831d-556b4ca14446 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:46.966233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:46.967081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:46.967365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:46.967641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] PATH_INFO: `/v3/projects/8ab3fbdb64844aaea524ce506e5818f2/users/988b1d475c134012956da39c71c3497f/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:46.982569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab3fbdb64844aaea524ce506e5818f2, user_id=988b1d475c134012956da39c71c3497f, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:46.985939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:46.998494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1409/2823] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:46 2022] PUT /identity/v3/projects/8ab3fbdb64844aaea524ce506e5818f2/users/988b1d475c134012956da39c71c3497f/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:47.003540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18027-9c02-4f8d-880f-4f2f5112b456 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:47.003829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18027-9c02-4f8d-880f-4f2f5112b456 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:47.004106 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18027-9c02-4f8d-880f-4f2f5112b456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:47.021194 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ac18027-9c02-4f8d-880f-4f2f5112b456 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:47.022414 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ac18027-9c02-4f8d-880f-4f2f5112b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:47.079708 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1415/2824] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:47.089135 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:47.090810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:47.146020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b845a-6b9f-407d-8197-58e4d651893b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:47.149587 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:47.150213 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:47.150493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:47.150768 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:47.160190 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:47.161628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:47.171005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1410/2825] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:47.754590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fae0-1c1b-455e-b568-e44ca4906e4d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:47.755006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fae0-1c1b-455e-b568-e44ca4906e4d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:47.755352 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fae0-1c1b-455e-b568-e44ca4906e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:47.782425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4369fae0-1c1b-455e-b568-e44ca4906e4d None None] MFA Rules not processed for user `988b1d475c134012956da39c71c3497f`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:47.783631 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4369fae0-1c1b-455e-b568-e44ca4906e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:47.851221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1416/2826] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:47.855698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:47.865307 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1497518-53f6-4f96-a696-031cb166bb79 service neutron] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:47.869946 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:47.870598 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:47.870882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:47.871160 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:47.871865 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:47.873772 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:47.902517 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1411/2827] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:59:47 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:47.904179 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fae0-1c1b-455e-b568-e44ca4906e4d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:47.915387 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fae0-1c1b-455e-b568-e44ca4906e4d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:47.960072 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:47.973919 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:47.974524 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:47.974813 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:47.975095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:47.975781 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:47.977729 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:47.997327 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1417/2828] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:59:47 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:59:48.001304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:48.011635 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe78d8-b551-40e7-beb3-ebea4694f1a0 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:48.016197 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:48.016851 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:48.017134 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:48.017413 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:48.018169 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:48.019780 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:48.030149 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1412/2829] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:48.034489 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:48.044186 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ed43c-ad21-4558-aaf0-87022f4038d3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:48.049252 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:48.050151 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:48.050435 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:48.050711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] PATH_INFO: `/v3/projects/4c63212643814aa093b1335b3b69f608/users/a213b410d4f44170b8171447f1490ce6/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:48.065439 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c63212643814aa093b1335b3b69f608, user_id=a213b410d4f44170b8171447f1490ce6, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:48.068130 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:48.081376 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1418/2830] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:48 2022] PUT /identity/v3/projects/4c63212643814aa093b1335b3b69f608/users/a213b410d4f44170b8171447f1490ce6/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:48.085164 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:48.095564 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5800e98-4fcb-4e90-b653-133ca34ca34b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:48.132218 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:48.152363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c577-50bf-4aaf-b106-6eb506d1d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:48.153021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c577-50bf-4aaf-b106-6eb506d1d72d admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:48.153303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c577-50bf-4aaf-b106-6eb506d1d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:48.153616 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c577-50bf-4aaf-b106-6eb506d1d72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:48.154333 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c577-50bf-4aaf-b106-6eb506d1d72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:48.156457 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c577-50bf-4aaf-b106-6eb506d1d72d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:48.166410 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1413/2831] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:48.170423 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:48.180521 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0219e9-6d1d-45d5-99b9-57bc7394afaa admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:48.185031 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:48.185926 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:48.186209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:48.186484 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] PATH_INFO: `/v3/projects/4c63212643814aa093b1335b3b69f608/users/a213b410d4f44170b8171447f1490ce6/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:48.188814 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c63212643814aa093b1335b3b69f608, user_id=a213b410d4f44170b8171447f1490ce6, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:48.191463 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:48.201385 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1419/2832] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:48 2022] PUT /identity/v3/projects/4c63212643814aa093b1335b3b69f608/users/a213b410d4f44170b8171447f1490ce6/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:48.835329 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7c7d-3254-48e1-8de3-b84e77c50f8e None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:48.835625 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7c7d-3254-48e1-8de3-b84e77c50f8e None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:48.835905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7c7d-3254-48e1-8de3-b84e77c50f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:48.862412 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d0ad7c7d-3254-48e1-8de3-b84e77c50f8e None None] MFA Rules not processed for user `a213b410d4f44170b8171447f1490ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:48.863637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d0ad7c7d-3254-48e1-8de3-b84e77c50f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:48.939500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1414/2833] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:49.936296 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:49.998278 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205b121-afeb-471e-9647-0f1549c0e6c1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:50.003348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:50.004206 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:50.004485 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:50.004761 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] PATH_INFO: `/v3/users/988b1d475c134012956da39c71c3497f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:50.005963 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=988b1d475c134012956da39c71c3497f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:50.008155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:50.054080 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988b1d475c134012956da39c71c3497f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.054732 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988b1d475c134012956da39c71c3497f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.062578 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988b1d475c134012956da39c71c3497f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.074973 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988b1d475c134012956da39c71c3497f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.075606 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988b1d475c134012956da39c71c3497f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.088336 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1420/2834] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:59:49 2022] DELETE /identity/v3/users/988b1d475c134012956da39c71c3497f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:50.261279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7c7d-3254-48e1-8de3-b84e77c50f8e None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:50.273219 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7c7d-3254-48e1-8de3-b84e77c50f8e None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:50.328798 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:50.329685 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:50.329969 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:50.330244 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] PATH_INFO: `/v3/projects/8ab3fbdb64844aaea524ce506e5818f2` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:50.331415 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab3fbdb64844aaea524ce506e5818f2)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:50.333304 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:50.382908 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab3fbdb64844aaea524ce506e5818f2', 'request_id': 'req-5b70bbb1-4744-4147-bdf8-108366fa7138'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.389743 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab3fbdb64844aaea524ce506e5818f2', 'request_id': 'req-5b70bbb1-4744-4147-bdf8-108366fa7138'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.396954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab3fbdb64844aaea524ce506e5818f2', 'request_id': 'req-5b70bbb1-4744-4147-bdf8-108366fa7138'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.402138 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:50.413795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] The token cache is being invalidate because project 8ab3fbdb64844aaea524ce506e5818f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:59:50.414081 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.414717 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.416277 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1415/2835] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:59:50 2022] DELETE /identity/v3/projects/8ab3fbdb64844aaea524ce506e5818f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:50.420232 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:50.422153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:50.434705 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee411ea-ccd5-4585-a657-d6e31017a23e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:50.451614 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:50.492022 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:50.492884 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:50.493167 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:50.493446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] PATH_INFO: `/v3/users/a213b410d4f44170b8171447f1490ce6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:50.494654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a213b410d4f44170b8171447f1490ce6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:50.496567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:50.544063 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a213b410d4f44170b8171447f1490ce6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.544704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a213b410d4f44170b8171447f1490ce6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.552441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a213b410d4f44170b8171447f1490ce6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.564937 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a213b410d4f44170b8171447f1490ce6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.565590 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c4a0f2d8-6d04-4eda-87c3-8da38a77c2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a213b410d4f44170b8171447f1490ce6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.577470 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1421/2836] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:59:50 2022] DELETE /identity/v3/users/a213b410d4f44170b8171447f1490ce6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:50.750278 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:50.751725 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:50.764427 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70bbb1-4744-4147-bdf8-108366fa7138 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:50.822521 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:50.823388 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:50.823672 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:50.823951 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] PATH_INFO: `/v3/projects/4c63212643814aa093b1335b3b69f608` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:50.825123 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c63212643814aa093b1335b3b69f608)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:50.827056 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:50.872680 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c63212643814aa093b1335b3b69f608', 'request_id': 'req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.878628 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c63212643814aa093b1335b3b69f608', 'request_id': 'req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.885623 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c63212643814aa093b1335b3b69f608', 'request_id': 'req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.895829 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] The token cache is being invalidate because project 4c63212643814aa093b1335b3b69f608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:59:50.896142 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.896806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c81b12e5-b7f0-47f3-8c25-2da3021f14f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:50.898377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1416/2837] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:59:50 2022] DELETE /identity/v3/projects/4c63212643814aa093b1335b3b69f608 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:50.903265 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7b2b6-cb19-44c5-8116-5f569c8ef981 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:50.903558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7b2b6-cb19-44c5-8116-5f569c8ef981 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:50.903839 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7b2b6-cb19-44c5-8116-5f569c8ef981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:50.922553 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-45e7b2b6-cb19-44c5-8116-5f569c8ef981 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:50.924041 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-45e7b2b6-cb19-44c5-8116-5f569c8ef981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:50.981907 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1422/2838] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:50.991370 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dcc64-e2df-47d6-880d-1aea7cd3e808 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:50.991659 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dcc64-e2df-47d6-880d-1aea7cd3e808 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:50.991935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dcc64-e2df-47d6-880d-1aea7cd3e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.010053 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-d33dcc64-e2df-47d6-880d-1aea7cd3e808 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:51.011261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-d33dcc64-e2df-47d6-880d-1aea7cd3e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:51.019256 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1417/2839] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:51.023268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7b2b6-cb19-44c5-8116-5f569c8ef981 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.033259 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7b2b6-cb19-44c5-8116-5f569c8ef981 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.037738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.038378 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.038660 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.038935 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.039651 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:59:51.039961 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.041573 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.053381 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1423/2840] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:59:51.057567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dcc64-e2df-47d6-880d-1aea7cd3e808 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.067066 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dcc64-e2df-47d6-880d-1aea7cd3e808 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.071718 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.072357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.072640 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.072922 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.073665 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.075546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.101763 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1418/2841] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:59:51 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:59:51.105540 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.115515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee09aa-fdb8-463f-9218-c6d7f6ef41e2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.138874 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:51.171975 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.172640 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.172923 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.173207 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.173932 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.175837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.195299 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1424/2842] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:59:51 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:51.199459 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.210377 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a82fe-5a7a-4bba-85ff-1200b28d1e3e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.215270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.215919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.216201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.216788 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.217553 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.219784 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.229909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1419/2843] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:51.233728 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.243586 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95792f0-0da8-4537-b8f2-9df572f0603d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.248165 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381b8c-5c1e-41ef-8f54-d054a075f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.248811 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381b8c-5c1e-41ef-8f54-d054a075f881 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.249097 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381b8c-5c1e-41ef-8f54-d054a075f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.249377 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381b8c-5c1e-41ef-8f54-d054a075f881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.250169 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381b8c-5c1e-41ef-8f54-d054a075f881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.251743 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381b8c-5c1e-41ef-8f54-d054a075f881 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.261546 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1425/2844] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:51.266084 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.275987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4979df-f0fd-454a-95ea-a1158bf22353 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.280789 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.282182 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.282461 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.282733 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] PATH_INFO: `/v3/projects/0ca6436106f3423d9280e2b0f8e5cc08/users/d74702e13bba462c806901428ed98352/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.297274 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca6436106f3423d9280e2b0f8e5cc08, user_id=d74702e13bba462c806901428ed98352, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.299948 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.312597 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1420/2845] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:51 2022] PUT /identity/v3/projects/0ca6436106f3423d9280e2b0f8e5cc08/users/d74702e13bba462c806901428ed98352/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:51.322906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992e16-1f37-4b4f-b227-e0f8e5076943 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.323199 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992e16-1f37-4b4f-b227-e0f8e5076943 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.323483 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992e16-1f37-4b4f-b227-e0f8e5076943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.350527 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b4992e16-1f37-4b4f-b227-e0f8e5076943 None None] MFA Rules not processed for user `d74702e13bba462c806901428ed98352`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:51.351808 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b4992e16-1f37-4b4f-b227-e0f8e5076943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:51.415057 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1426/2846] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:51.419270 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.438993 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:51.484855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3eda2-cd34-4a68-82d0-27894f93623a admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.489567 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.490225 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.490514 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.490795 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.491494 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.493381 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.518757 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1421/2847] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:59:51 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:59:51.522815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4992e16-1f37-4b4f-b227-e0f8e5076943 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.533667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4992e16-1f37-4b4f-b227-e0f8e5076943 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.588009 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.588667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.588954 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.589229 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.589957 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.591853 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.611787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1427/2848] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:59:51 2022] POST /identity/v3/users => generated 306 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:51.615719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.626406 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8865e2-e8bd-4cc1-88d8-84ecfe1ed11d admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.631078 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.631729 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.632013 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.632292 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.633015 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.634633 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.645550 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1422/2849] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:51.649496 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.659176 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf827b76-c480-4cfc-a6cb-3b2e1ba8ade9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.663797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.664598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.664876 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.665148 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] PATH_INFO: `/v3/projects/7daea49df03b4202a80ed482512cf878/users/7e037a3304084b2fa6f76362e0601598/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.681474 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7daea49df03b4202a80ed482512cf878, user_id=7e037a3304084b2fa6f76362e0601598, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.684078 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.693287 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:51.698392 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1428/2850] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:51 2022] PUT /identity/v3/projects/7daea49df03b4202a80ed482512cf878/users/7e037a3304084b2fa6f76362e0601598/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:51.702359 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.712891 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff45903-f45c-43a7-b3e5-8b9e37484dfe admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.768368 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e298df-2a32-44c2-9ce9-8c8f20ffc601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.769027 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e298df-2a32-44c2-9ce9-8c8f20ffc601 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.769316 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e298df-2a32-44c2-9ce9-8c8f20ffc601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.769629 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e298df-2a32-44c2-9ce9-8c8f20ffc601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.770350 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e298df-2a32-44c2-9ce9-8c8f20ffc601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.771945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e298df-2a32-44c2-9ce9-8c8f20ffc601 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.781591 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1423/2851] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:51.785773 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.795895 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a922c81-6a42-4c88-838f-0f8ea007f789 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.801040 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.801750 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.802028 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.802321 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] PATH_INFO: `/v3/projects/7daea49df03b4202a80ed482512cf878/users/7e037a3304084b2fa6f76362e0601598/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.804281 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7daea49df03b4202a80ed482512cf878, user_id=7e037a3304084b2fa6f76362e0601598, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:51.806915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:51.818093 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1429/2852] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:51 2022] PUT /identity/v3/projects/7daea49df03b4202a80ed482512cf878/users/7e037a3304084b2fa6f76362e0601598/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:51.828542 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf80eca-f9f9-43aa-a6f4-85db9dda716b None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.828836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf80eca-f9f9-43aa-a6f4-85db9dda716b None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.829148 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf80eca-f9f9-43aa-a6f4-85db9dda716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:51.854636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-aaf80eca-f9f9-43aa-a6f4-85db9dda716b None None] MFA Rules not processed for user `7e037a3304084b2fa6f76362e0601598`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:51.855835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-aaf80eca-f9f9-43aa-a6f4-85db9dda716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:51.925631 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1424/2853] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:59:51.936006 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:51.938247 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:51.993841 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67844-6789-4161-ab98-55e340ce53c2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:51.997413 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:51.998068 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:51.998349 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:51.998619 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:52.007996 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:52.009397 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:52.018739 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1430/2854] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:52.088697 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf80eca-f9f9-43aa-a6f4-85db9dda716b None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:52.098363 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf80eca-f9f9-43aa-a6f4-85db9dda716b None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:52.101968 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3af2-5ff7-4c6a-8312-9dc3c2f8c32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:52.102595 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3af2-5ff7-4c6a-8312-9dc3c2f8c32a service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:52.102875 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3af2-5ff7-4c6a-8312-9dc3c2f8c32a service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:52.103145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3af2-5ff7-4c6a-8312-9dc3c2f8c32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:52.112698 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:52.160569 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3af2-5ff7-4c6a-8312-9dc3c2f8c32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:52.162026 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3af2-5ff7-4c6a-8312-9dc3c2f8c32a service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:52.170923 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1425/2855] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:56.156988 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:56.217706 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888c4f-5661-4e32-b45e-4c2d38804f0d service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:56.222114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:56.222960 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:56.223240 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:56.223511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] PATH_INFO: `/v3/users/d74702e13bba462c806901428ed98352` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:56.224667 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74702e13bba462c806901428ed98352)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:56.226585 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:56.270865 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74702e13bba462c806901428ed98352'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.271434 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74702e13bba462c806901428ed98352'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.278696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74702e13bba462c806901428ed98352'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.290942 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74702e13bba462c806901428ed98352'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.291596 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74702e13bba462c806901428ed98352'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.304214 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1431/2856] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:59:56 2022] DELETE /identity/v3/users/d74702e13bba462c806901428ed98352 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:56.308735 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:56.309196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:56.309327 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:56.326847 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:56.328050 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:56.386234 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1426/2857] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:59:56.395659 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:56.397046 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:56.407936 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:56.460162 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811f0e3-0d58-4b65-aa76-f6e5bea6d337 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:56.463736 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:56.464371 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:56.464652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:56.464925 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:56.473686 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:56.475098 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:56.484268 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1432/2858] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:56.744568 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:56.746046 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:56.758544 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e206a-c00b-4fc2-b676-a058de1948c3 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:56.763395 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:56.764282 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:56.764576 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:56.764843 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] PATH_INFO: `/v3/projects/0ca6436106f3423d9280e2b0f8e5cc08` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:56.766770 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca6436106f3423d9280e2b0f8e5cc08)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:56.768700 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:56.814960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca6436106f3423d9280e2b0f8e5cc08', 'request_id': 'req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.821034 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca6436106f3423d9280e2b0f8e5cc08', 'request_id': 'req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.829242 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca6436106f3423d9280e2b0f8e5cc08', 'request_id': 'req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.839637 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] The token cache is being invalidate because project 0ca6436106f3423d9280e2b0f8e5cc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:59:56.839924 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.840546 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.842112 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1427/2859] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:59:56 2022] DELETE /identity/v3/projects/0ca6436106f3423d9280e2b0f8e5cc08 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:56.846183 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:56.855815 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01058de-8cdc-44f0-97d4-1d7500b64d7f service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:56.910654 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:56.911518 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:56.911799 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:56.912071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] PATH_INFO: `/v3/users/7e037a3304084b2fa6f76362e0601598` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:56.913250 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e037a3304084b2fa6f76362e0601598)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:56.915200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:56.961204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e037a3304084b2fa6f76362e0601598'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.961860 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e037a3304084b2fa6f76362e0601598'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.968715 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e037a3304084b2fa6f76362e0601598'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.981117 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e037a3304084b2fa6f76362e0601598'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.981763 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a67f0145-c7c2-4d1c-b4d7-a204dc2a7558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e037a3304084b2fa6f76362e0601598'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:56.994221 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1433/2860] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 13:59:56 2022] DELETE /identity/v3/users/7e037a3304084b2fa6f76362e0601598 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:57.259855 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:57.261303 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:57.276419 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61aa015-eea9-4bd4-bb7c-17b0bbdbdff3 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:57.309422 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:57.336499 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:57.337407 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.337745 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.338032 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] PATH_INFO: `/v3/projects/7daea49df03b4202a80ed482512cf878` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.339358 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7daea49df03b4202a80ed482512cf878)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:57.341337 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:57.387960 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7daea49df03b4202a80ed482512cf878', 'request_id': 'req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:57.393909 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7daea49df03b4202a80ed482512cf878', 'request_id': 'req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:57.401009 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7daea49df03b4202a80ed482512cf878', 'request_id': 'req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:57.411643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] The token cache is being invalidate because project 7daea49df03b4202a80ed482512cf878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:59:57.411929 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:57.412571 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-93da8529-9dce-4f33-b4e6-0d9dcf71c66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:59:57.414119 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1428/2861] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 13:59:57 2022] DELETE /identity/v3/projects/7daea49df03b4202a80ed482512cf878 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:57.419724 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bb7f-95ee-4948-bc3d-99d7f6013a3a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.420196 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bb7f-95ee-4948-bc3d-99d7f6013a3a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.420312 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bb7f-95ee-4948-bc3d-99d7f6013a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.438809 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d437bb7f-95ee-4948-bc3d-99d7f6013a3a None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:57.440003 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d437bb7f-95ee-4948-bc3d-99d7f6013a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:57.465295 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:57.499946 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1434/2862] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:57.508373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091770-4a50-4de6-aa8d-db85c0c0a751 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.508666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091770-4a50-4de6-aa8d-db85c0c0a751 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.508947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091770-4a50-4de6-aa8d-db85c0c0a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.526551 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-b2091770-4a50-4de6-aa8d-db85c0c0a751 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:57.527776 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-b2091770-4a50-4de6-aa8d-db85c0c0a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:57.536040 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1429/2863] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:57.540110 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437bb7f-95ee-4948-bc3d-99d7f6013a3a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:57.550399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437bb7f-95ee-4948-bc3d-99d7f6013a3a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:57.554924 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:57.555566 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.555851 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.556133 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.556854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:59:57.557163 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:57.558786 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:57.570330 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1435/2864] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:59:57.574365 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091770-4a50-4de6-aa8d-db85c0c0a751 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:57.583455 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091770-4a50-4de6-aa8d-db85c0c0a751 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:57.588062 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:57.588706 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.588987 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.589261 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.589988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:57.591905 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:57.617111 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1430/2865] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:59:57 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:57.621005 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:57.630863 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddc30b-69ca-477e-b9b8-5225e654ee0f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:57.685738 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:57.686393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.686678 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.686952 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.687671 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:57.689864 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:57.709286 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1436/2866] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:59:57 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:57.713376 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:57.724318 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320383b8-2639-47ee-94e8-6df82e962269 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:57.728966 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:57.729666 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.729954 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.730230 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.730952 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:57.732534 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:57.743604 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1431/2867] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:57.747096 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:57.756776 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2662f-462a-4ef9-a2ee-fe3e7df80992 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:57.761337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25e24-07af-4bb0-980a-c2cdcb8e6db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:57.762012 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25e24-07af-4bb0-980a-c2cdcb8e6db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.762297 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25e24-07af-4bb0-980a-c2cdcb8e6db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.762575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25e24-07af-4bb0-980a-c2cdcb8e6db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.763290 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25e24-07af-4bb0-980a-c2cdcb8e6db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:57.764878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25e24-07af-4bb0-980a-c2cdcb8e6db6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:57.774570 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1437/2868] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:57.778367 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:57.788915 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80703-1af3-4761-8e0e-4efef8aea2e8 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:57.793473 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:57.794354 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.794641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.794918 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] PATH_INFO: `/v3/projects/1dc7e716fc5045c6a1c2e53f8bd0b308/users/1dfea2f1081b434ab3d24733979342e3/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.809925 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc7e716fc5045c6a1c2e53f8bd0b308, user_id=1dfea2f1081b434ab3d24733979342e3, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:57.812641 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:57.826985 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1432/2869] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:57 2022] PUT /identity/v3/projects/1dc7e716fc5045c6a1c2e53f8bd0b308/users/1dfea2f1081b434ab3d24733979342e3/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:57.837575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da174-a941-433e-b471-c8fd5aa90595 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:57.837872 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da174-a941-433e-b471-c8fd5aa90595 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:57.838185 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da174-a941-433e-b471-c8fd5aa90595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:57.864424 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-826da174-a941-433e-b471-c8fd5aa90595 None None] MFA Rules not processed for user `1dfea2f1081b434ab3d24733979342e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:57.865633 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-826da174-a941-433e-b471-c8fd5aa90595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:57.943820 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1438/2870] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:57.948279 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.008890 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0893cbb-ec35-4f27-b75c-0a57fdb46262 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.013449 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.014129 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.014414 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.014691 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.015385 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.017777 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.021742 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:58.043405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1433/2871] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 13:59:57 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:59:58.047337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da174-a941-433e-b471-c8fd5aa90595 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.057821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da174-a941-433e-b471-c8fd5aa90595 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.081886 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:58.114768 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.115419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.115704 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.115981 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.116679 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.118609 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.137481 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1439/2872] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 13:59:58 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:59:58.142011 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.152118 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cba8a-20d4-457b-9b36-235ef33d09d2 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.157233 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.157919 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.158205 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.158484 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.159201 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.160812 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.171158 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1434/2873] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:58.175032 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.185114 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68142788-05ff-45a0-ac4c-81e1b19e4f2d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.190365 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.191230 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.191510 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.191784 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] PATH_INFO: `/v3/projects/ba6e2cfe992b46339c9262389cfe522d/users/ef290d4613ef4677b39f54e950ce1948/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.207929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6e2cfe992b46339c9262389cfe522d, user_id=ef290d4613ef4677b39f54e950ce1948, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.210600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.223081 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1440/2874] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:58 2022] PUT /identity/v3/projects/ba6e2cfe992b46339c9262389cfe522d/users/ef290d4613ef4677b39f54e950ce1948/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:58.226921 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.236815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a1df-7591-467d-9e6d-a5e54d6ed375 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.291145 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e905c9-6dab-44ee-b285-66c8e77e1b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.291796 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e905c9-6dab-44ee-b285-66c8e77e1b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.292108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e905c9-6dab-44ee-b285-66c8e77e1b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.292387 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e905c9-6dab-44ee-b285-66c8e77e1b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.293099 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e905c9-6dab-44ee-b285-66c8e77e1b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.294723 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e905c9-6dab-44ee-b285-66c8e77e1b8e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.304198 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1435/2875] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:59:58.308220 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.319112 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24152ab-b264-4cb3-a985-bee6e338211c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.323644 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.324508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.324787 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.325060 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] PATH_INFO: `/v3/projects/ba6e2cfe992b46339c9262389cfe522d/users/ef290d4613ef4677b39f54e950ce1948/roles/e63cac3eb6e14081b96e468e268bdb09` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.327020 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6e2cfe992b46339c9262389cfe522d, user_id=ef290d4613ef4677b39f54e950ce1948, role_id=e63cac3eb6e14081b96e468e268bdb09)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.330178 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.340168 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1441/2876] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 13:59:58 2022] PUT /identity/v3/projects/ba6e2cfe992b46339c9262389cfe522d/users/ef290d4613ef4677b39f54e950ce1948/roles/e63cac3eb6e14081b96e468e268bdb09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:59:58.350983 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebc1c-40a8-4fae-8b79-0ab505d7e2dc None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.351487 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebc1c-40a8-4fae-8b79-0ab505d7e2dc None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.351607 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebc1c-40a8-4fae-8b79-0ab505d7e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.378942 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-717ebc1c-40a8-4fae-8b79-0ab505d7e2dc None None] MFA Rules not processed for user `ef290d4613ef4677b39f54e950ce1948`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:59:58.380071 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-717ebc1c-40a8-4fae-8b79-0ab505d7e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:58.446450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1436/2877] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:59:58.457707 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.459455 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:59:58.514769 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca73f4-3571-456a-ba5b-bcc758f0c364 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.518977 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.519610 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.519891 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.520166 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.529048 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.530502 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.539927 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1442/2878] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:59:58.636020 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebc1c-40a8-4fae-8b79-0ab505d7e2dc None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:59:58.645682 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebc1c-40a8-4fae-8b79-0ab505d7e2dc None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:59:58.649253 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd3ceb-d717-4ce5-b49a-94654b5ffd6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:59:58.649940 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd3ceb-d717-4ce5-b49a-94654b5ffd6a service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:59:58.650223 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd3ceb-d717-4ce5-b49a-94654b5ffd6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:59:58.650493 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd3ceb-d717-4ce5-b49a-94654b5ffd6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:59:58.704649 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:59:58.707106 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd3ceb-d717-4ce5-b49a-94654b5ffd6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:59:58.709021 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd3ceb-d717-4ce5-b49a-94654b5ffd6a service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:59:58.718806 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1437/2879] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 13:59:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 14:00:01.265030 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:01.325692 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff084200-ea38-4b41-bd33-90306a3dae52 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:01.330209 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:01.331064 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:01.331348 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:01.331625 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] PATH_INFO: `/v3/users/1dfea2f1081b434ab3d24733979342e3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:01.332785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfea2f1081b434ab3d24733979342e3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:01.334723 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:01.357393 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:00:01.382446 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfea2f1081b434ab3d24733979342e3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.383095 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfea2f1081b434ab3d24733979342e3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.390116 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfea2f1081b434ab3d24733979342e3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.401821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfea2f1081b434ab3d24733979342e3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.402440 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfea2f1081b434ab3d24733979342e3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.414794 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1443/2880] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 14:00:01 2022] DELETE /identity/v3/users/1dfea2f1081b434ab3d24733979342e3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 14:00:01.419238 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:01.420007 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:01.420373 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:01.437537 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 14:00:01.438988 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:01.496254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1438/2881] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 14:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 14:00:01.505652 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:01.507084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:01.562789 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8078f-5fa8-4394-9088-b473ff0272ac admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:01.566637 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:01.567272 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:01.567558 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:01.567837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:01.576632 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:01.578600 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:01.587837 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1444/2882] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 14:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 14:00:01.842315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:01.843771 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:01.856063 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916369ef-ba91-4f19-b21f-21979f875afa None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:01.861287 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:01.862322 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:01.862608 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:01.862882 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] PATH_INFO: `/v3/projects/1dc7e716fc5045c6a1c2e53f8bd0b308` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:01.864057 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc7e716fc5045c6a1c2e53f8bd0b308)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:01.866108 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:01.912540 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc7e716fc5045c6a1c2e53f8bd0b308', 'request_id': 'req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.918485 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc7e716fc5045c6a1c2e53f8bd0b308', 'request_id': 'req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.927513 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc7e716fc5045c6a1c2e53f8bd0b308', 'request_id': 'req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.938222 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] The token cache is being invalidate because project 1dc7e716fc5045c6a1c2e53f8bd0b308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 14:00:01.938762 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.939416 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:01.940934 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1439/2883] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 14:00:01 2022] DELETE /identity/v3/projects/1dc7e716fc5045c6a1c2e53f8bd0b308 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 14:00:01.944828 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:01.954419 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb28b9-5db4-41cd-82de-e799d0bb46af service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.009829 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.010696 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.010980 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.011255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] PATH_INFO: `/v3/users/ef290d4613ef4677b39f54e950ce1948` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.012425 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef290d4613ef4677b39f54e950ce1948)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.014366 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.057399 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:00:02.058966 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef290d4613ef4677b39f54e950ce1948'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.059944 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef290d4613ef4677b39f54e950ce1948'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.068212 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef290d4613ef4677b39f54e950ce1948'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.080855 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef290d4613ef4677b39f54e950ce1948'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.081536 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7f0b46e3-a3fa-4873-9d7a-5f391d7cf4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef290d4613ef4677b39f54e950ce1948'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.093421 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1445/2884] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 14:00:01 2022] DELETE /identity/v3/users/ef290d4613ef4677b39f54e950ce1948 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 14:00:02.365670 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:02.367196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:02.381500 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981df6ba-7e81-4bc8-a6a3-eae371f7fd5f admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.437241 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.439069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.439357 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.439636 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] PATH_INFO: `/v3/projects/ba6e2cfe992b46339c9262389cfe522d` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.440828 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6e2cfe992b46339c9262389cfe522d)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.442799 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.465204 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:00:02.489043 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6e2cfe992b46339c9262389cfe522d', 'request_id': 'req-4df42b17-4706-4b48-b17a-f2d1da5d08ee'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.495117 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6e2cfe992b46339c9262389cfe522d', 'request_id': 'req-4df42b17-4706-4b48-b17a-f2d1da5d08ee'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.502643 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6e2cfe992b46339c9262389cfe522d', 'request_id': 'req-4df42b17-4706-4b48-b17a-f2d1da5d08ee'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.512912 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] The token cache is being invalidate because project ba6e2cfe992b46339c9262389cfe522d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 14:00:02.513196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.513836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-4df42b17-4706-4b48-b17a-f2d1da5d08ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:02.515362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1440/2885] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 14:00:02 2022] DELETE /identity/v3/projects/ba6e2cfe992b46339c9262389cfe522d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 14:00:02.520155 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da10c6e-df66-4c42-992c-b9c5c744f21b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.520662 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da10c6e-df66-4c42-992c-b9c5c744f21b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.520774 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da10c6e-df66-4c42-992c-b9c5c744f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.537711 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3da10c6e-df66-4c42-992c-b9c5c744f21b None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 14:00:02.538912 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3da10c6e-df66-4c42-992c-b9c5c744f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:02.596618 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1446/2886] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 14:00:02.604266 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217346e-8705-40e4-905b-3172ddbd7533 None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.604557 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217346e-8705-40e4-905b-3172ddbd7533 None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.604835 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217346e-8705-40e4-905b-3172ddbd7533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.623178 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-2217346e-8705-40e4-905b-3172ddbd7533 None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 14:00:02.624362 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-2217346e-8705-40e4-905b-3172ddbd7533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:02.632779 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1441/2887] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 14:00:02.636898 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da10c6e-df66-4c42-992c-b9c5c744f21b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:02.647204 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da10c6e-df66-4c42-992c-b9c5c744f21b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.651866 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.652549 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.652830 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.653102 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.653893 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 14:00:02.654200 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.655785 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.667821 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1447/2888] 10.222.0.47 () {58 vars in 1152 bytes} [Thu Jun 30 14:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 14:00:02.671860 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217346e-8705-40e4-905b-3172ddbd7533 None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:02.680947 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217346e-8705-40e4-905b-3172ddbd7533 None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.685557 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.686189 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.686470 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.687267 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.688719 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.690646 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.715216 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1442/2889] 10.222.0.47 () {60 vars in 1152 bytes} [Thu Jun 30 14:00:02 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 14:00:02.719084 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:02.728797 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d452-5d8c-4dee-ba8a-21ba9e95eff0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.783648 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.784310 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.784598 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.784878 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.785604 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.787508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.806337 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1448/2890] 10.222.0.47 () {60 vars in 1143 bytes} [Thu Jun 30 14:00:02 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 14:00:02.810480 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:02.821601 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a705da-f175-44e4-9c3c-e31de9651a3e admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.826450 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.827107 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.827396 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.827674 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.828939 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.830560 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.840836 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1443/2891] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 14:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 14:00:02.844620 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:02.854417 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed4dba-67ed-4a8f-b4f4-555c36fbb11b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.858929 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f8660-1d57-4ec7-a389-61aa4e0861af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.859575 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f8660-1d57-4ec7-a389-61aa4e0861af admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.859861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f8660-1d57-4ec7-a389-61aa4e0861af admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.860140 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f8660-1d57-4ec7-a389-61aa4e0861af admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.860854 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f8660-1d57-4ec7-a389-61aa4e0861af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.862465 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f8660-1d57-4ec7-a389-61aa4e0861af admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.872367 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1449/2892] 10.222.0.47 () {58 vars in 1121 bytes} [Thu Jun 30 14:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 14:00:02.876613 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:02.886405 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e133f-8be2-4db8-b6e3-9e644da59419 admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:02.891580 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:02.892442 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.892727 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.893005 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] PATH_INFO: `/v3/projects/8b0c451d8c834d738da7d2abe62b0a89/users/afa311fbdf1141718574c49fac724725/roles/f9fe11246d7c4aaba2b519a7f18f691a` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.907324 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0c451d8c834d738da7d2abe62b0a89, user_id=afa311fbdf1141718574c49fac724725, role_id=f9fe11246d7c4aaba2b519a7f18f691a)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:02.909990 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:02.922810 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1444/2893] 10.222.0.47 () {60 vars in 1482 bytes} [Thu Jun 30 14:00:02 2022] PUT /identity/v3/projects/8b0c451d8c834d738da7d2abe62b0a89/users/afa311fbdf1141718574c49fac724725/roles/f9fe11246d7c4aaba2b519a7f18f691a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 14:00:02.932833 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c9b3-4b72-4d39-8f9c-bd3f32161577 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:02.933127 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c9b3-4b72-4d39-8f9c-bd3f32161577 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:02.933409 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c9b3-4b72-4d39-8f9c-bd3f32161577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:02.960233 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2719c9b3-4b72-4d39-8f9c-bd3f32161577 None None] MFA Rules not processed for user `afa311fbdf1141718574c49fac724725`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 14:00:02.961432 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2719c9b3-4b72-4d39-8f9c-bd3f32161577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:02.977969 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:00:03.025387 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1450/2894] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 14:00:03.036898 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:03.038606 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:03.095584 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739549-3794-43e4-9ab9-9c9980b5fb7b admin admin] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:03.099254 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5a1ce-ffcb-465f-81b9-b11bed0d7e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a850623f9b43f580dcdc7380ca9ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:03.099893 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a1ce-ffcb-465f-81b9-b11bed0d7e34 service cinder] REQUEST_METHOD: `GET` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:03.100180 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a1ce-ffcb-465f-81b9-b11bed0d7e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:03.100456 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a1ce-ffcb-465f-81b9-b11bed0d7e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:03.108724 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5a1ce-ffcb-465f-81b9-b11bed0d7e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:03.110150 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5a1ce-ffcb-465f-81b9-b11bed0d7e34 service cinder] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:03.118935 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1445/2895] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 14:00:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 14:00:03.138688 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719c9b3-4b72-4d39-8f9c-bd3f32161577 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:03.199906 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719c9b3-4b72-4d39-8f9c-bd3f32161577 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:03.204978 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:03.205861 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:03.206143 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:03.206416 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] PATH_INFO: `/v3/users/afa311fbdf1141718574c49fac724725` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:03.207634 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa311fbdf1141718574c49fac724725)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:03.209561 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:03.255668 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa311fbdf1141718574c49fac724725'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.256320 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa311fbdf1141718574c49fac724725'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.263509 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa311fbdf1141718574c49fac724725'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.275515 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa311fbdf1141718574c49fac724725'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.276153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa311fbdf1141718574c49fac724725'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.288567 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1451/2896] 10.222.0.47 () {58 vars in 1223 bytes} [Thu Jun 30 14:00:03 2022] DELETE /identity/v3/users/afa311fbdf1141718574c49fac724725 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 14:00:03.293002 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] REQUEST_METHOD: `POST` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:03.293296 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:03.293612 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:03.310518 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.auth.core [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] MFA Rules not processed for user `baef3d38cf16460a9e38da424a63acd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 14:00:03.311748 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:03.357069 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:00:03.373315 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1446/2897] 10.222.0.47 () {58 vars in 957 bytes} [Thu Jun 30 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 14:00:03.382748 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:03.384174 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:03.426285 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:00:03.443559 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11325ec4-44e9-4a64-8d47-79aa5af1664c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:03.447149 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a5a31ddbe04b2490689adcbe76f9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:03.447790 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:03.448071 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:03.448345 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:03.457795 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:03.459255 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:03.469225 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1452/2898] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 14:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 14:00:03.729815 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] Authenticating user token {{(pid=80036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:00:03.731451 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.fernet_utils [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:00:03.745125 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3fc75-f607-494c-8cec-b9d6e223499f None None] Validating token access rules against request {{(pid=80036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:00:03.749766 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baef3d38cf16460a9e38da424a63acd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ffb94c3eb4e4540b84c4cb9fb570f96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:00:03.751260 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:00:03.751548 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:00:03.751945 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] PATH_INFO: `/v3/projects/8b0c451d8c834d738da7d2abe62b0a89` {{(pid=80036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:00:03.753114 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0c451d8c834d738da7d2abe62b0a89)` {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:00:03.755054 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] RBAC: Authorization granted {{(pid=80036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:00:03.801941 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0c451d8c834d738da7d2abe62b0a89', 'request_id': 'req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.807861 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0c451d8c834d738da7d2abe62b0a89', 'request_id': 'req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.815196 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0c451d8c834d738da7d2abe62b0a89', 'request_id': 'req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04'} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.825614 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] The token cache is being invalidate because project 8b0c451d8c834d738da7d2abe62b0a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 14:00:03.825903 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.826523 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG keystone.notifications [None req-69f7066e-e5e8-4b64-b7fe-33c3f44eed04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 14:00:03.828520 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: [pid: 80036|app: 0|req: 1447/2899] 10.222.0.47 () {58 vars in 1232 bytes} [Thu Jun 30 14:00:03 2022] DELETE /identity/v3/projects/8b0c451d8c834d738da7d2abe62b0a89 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 14:00:13.464511 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=9 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:00:13.822506 dv-cinder-822821-3-iscsi devstack@keystone.service[80036]: DEBUG dbcounter [-] [80036] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 14:03:34.773249 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 14:03:34.774703 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:03:34.881260 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d92fb-eb21-4f07-9418-3085b78a03ae service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 14:03:34.938508 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4568d-6703-40fc-98c0-1071b3f9d084 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaaa0a5f15ee4338a750795e4abbb64d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a790e3a63e7e4e2b8ba693d6331e81c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 14:03:34.939153 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4568d-6703-40fc-98c0-1071b3f9d084 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 14:03:34.939441 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4568d-6703-40fc-98c0-1071b3f9d084 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 14:03:34.939727 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4568d-6703-40fc-98c0-1071b3f9d084 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 14:03:34.941520 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54b4568d-6703-40fc-98c0-1071b3f9d084 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 14:03:34.952534 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4568d-6703-40fc-98c0-1071b3f9d084 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 14:03:34.954134 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4568d-6703-40fc-98c0-1071b3f9d084 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 14:03:34.963947 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1453/2900] 10.222.0.47 () {60 vars in 1365 bytes} [Thu Jun 30 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 14:03:44.959915 dv-cinder-822821-3-iscsi devstack@keystone.service[80037]: DEBUG dbcounter [-] [80037] Writing DB stats keystone:SELECT=75 {{(pid=80037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}